Aug 01 08:04:14 user nova-compute[72426]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 01 08:04:17 user nova-compute[72426]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72426) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72426) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72426) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 08:04:17 user nova-compute[72426]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:04:17 user nova-compute[72426]: INFO nova.virt.driver [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 01 08:04:17 user nova-compute[72426]: INFO nova.compute.provider_config [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] Acquiring lock "singleton_lock" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] Acquired lock "singleton_lock" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] Releasing lock "singleton_lock" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] Full set of CONF: {{(pid=72426) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ******************************************************************************** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] Configuration options gathered from: {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ================================================================================ {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] allow_resize_to_same_host      = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] arq_binding_timeout            = 300 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] backdoor_port                  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] backdoor_socket                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] block_device_allocate_retries  = 300 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] block_device_allocate_retries_interval = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cert                           = self.pem {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute_monitors               = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] config_dir                     = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] config_drive_format            = iso9660 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] config_source                  = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] console_host                   = user {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] control_exchange               = nova {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cpu_allocation_ratio           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] daemon                         = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] debug                          = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] default_access_ip_network_name = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] default_availability_zone      = nova {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] default_ephemeral_format       = ext4 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] default_schedule_zone          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] disk_allocation_ratio          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] enable_new_services            = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] enabled_ssl_apis               = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] flat_injected                  = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] force_config_drive             = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] force_raw_images               = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] graceful_shutdown_timeout      = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] heal_instance_info_cache_interval = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] host                           = user {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] instance_build_timeout         = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] instance_delete_interval       = 300 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] instance_name_template         = instance-%08x {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] instance_usage_audit           = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] instance_usage_audit_period    = month {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] internal_service_availability_zone = internal {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] key                            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] live_migration_retry_count     = 30 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] log_config_append              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] log_dir                        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] log_file                       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] log_options                    = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] log_rotate_interval            = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] log_rotate_interval_type       = days {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] log_rotation_type              = none {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] long_rpc_timeout               = 1800 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] max_concurrent_builds          = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] max_concurrent_live_migrations = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] max_concurrent_snapshots       = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] max_local_block_devices        = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] max_logfile_count              = 30 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] max_logfile_size_mb            = 200 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] maximum_instance_delete_attempts = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] metadata_listen                = 0.0.0.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] metadata_listen_port           = 8775 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] metadata_workers               = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] migrate_max_retries            = -1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] mkisofs_cmd                    = genisoimage {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] my_ip                          = 10.0.0.210 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] network_allocate_retries       = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] osapi_compute_listen_port      = 8774 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] osapi_compute_unique_server_name_scope =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] osapi_compute_workers          = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] password_length                = 12 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] periodic_enable                = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] periodic_fuzzy_delay           = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] pointer_model                  = ps2mouse {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] preallocate_images             = none {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] publish_errors                 = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] pybasedir                      = /opt/stack/nova {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ram_allocation_ratio           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] rate_limit_burst               = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] rate_limit_except_level        = CRITICAL {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] rate_limit_interval            = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] reboot_timeout                 = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] reclaim_instance_interval      = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] record                         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] reimage_timeout_per_gb         = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] report_interval                = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] rescue_timeout                 = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] reserved_host_cpus             = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] reserved_host_disk_mb          = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] reserved_host_memory_mb        = 512 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] reserved_huge_pages            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] resize_confirm_window          = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] resize_fs_using_block_device   = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] resume_guests_state_on_host_boot = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] rpc_response_timeout           = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] run_external_periodic_tasks    = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] running_deleted_instance_action = reap {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] running_deleted_instance_timeout = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler_instance_sync_interval = 120 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_down_time              = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] servicegroup_driver            = db {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] shelved_offload_time           = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] shelved_poll_interval          = 3600 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] shutdown_timeout               = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] source_is_ipv6                 = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ssl_only                       = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] state_path                     = /opt/stack/data/nova {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] sync_power_state_interval      = 600 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] sync_power_state_pool_size     = 1000 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] syslog_log_facility            = LOG_USER {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] tempdir                        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] timeout_nbd                    = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] transport_url                  = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] update_resources_interval      = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] use_cow_images                 = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] use_eventlog                   = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] use_journal                    = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] use_json                       = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] use_rootwrap_daemon            = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] use_stderr                     = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] use_syslog                     = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vcpu_pin_set                   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plugging_is_fatal          = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plugging_timeout           = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] virt_mkfs                      = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] volume_usage_poll_interval     = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] watch_log_file                 = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] web                            = /usr/share/spice-html5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_concurrency.disable_process_locking = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.auth_strategy              = keystone {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.compute_link_prefix        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.dhcp_domain                = novalocal {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.enable_instance_password   = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.glance_link_prefix         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.instance_list_per_project_cells = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.list_records_by_skipping_down_cells = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.local_metadata_per_cell    = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.max_limit                  = 1000 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.metadata_cache_expiration  = 15 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.neutron_default_tenant_id  = default {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.use_forwarded_for          = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.use_neutron_default_nets   = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.vendordata_dynamic_targets = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.vendordata_jsonfile_path   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.backend_argument         = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.config_prefix            = cache.oslo {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.dead_timeout             = 60.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.debug_cache_backend      = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.enable_retry_client      = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.enable_socket_keepalive  = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.enabled                  = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.expiration_time          = 600 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.hashclient_retry_attempts = 2 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.memcache_dead_retry      = 300 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.memcache_password        =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.memcache_sasl_enabled    = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.memcache_username        =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.proxies                  = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.retry_attempts           = 2 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.retry_delay              = 0.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.socket_keepalive_count   = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.socket_keepalive_idle    = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.socket_keepalive_interval = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.tls_allowed_ciphers      = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.tls_cafile               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.tls_certfile             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.tls_enabled              = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cache.tls_keyfile              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.auth_section            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.auth_type               = password {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.cafile                  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.certfile                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.collect_timing          = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.cross_az_attach         = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.debug                   = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.endpoint_template       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.http_retries            = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.insecure                = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.keyfile                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.os_region_name          = RegionOne {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.split_loggers           = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cinder.timeout                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.cpu_dedicated_set      = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.cpu_shared_set         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.image_type_exclude_list = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.resource_provider_association_refresh = 300 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.shutdown_retry_interval = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] conductor.workers              = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] console.allowed_origins        = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] console.ssl_ciphers            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] console.ssl_minimum_version    = default {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] consoleauth.token_ttl          = 600 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.cafile                  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.certfile                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.collect_timing          = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.connect_retries         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.connect_retry_delay     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.endpoint_override       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.insecure                = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.keyfile                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.max_version             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.min_version             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.region_name             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.service_name            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.service_type            = accelerator {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.split_loggers           = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.status_code_retries     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.status_code_retry_delay = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.timeout                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] cyborg.version                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.backend               = sqlalchemy {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.connection            = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.connection_debug      = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.connection_parameters =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.connection_recycle_time = 3600 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.connection_trace      = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.db_inc_retry_interval = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.db_max_retries        = 20 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.db_max_retry_interval = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.db_retry_interval     = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.max_overflow          = 50 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.max_pool_size         = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.max_retries           = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.mysql_enable_ndb      = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.mysql_wsrep_sync_wait = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.pool_timeout          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.retry_interval        = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.slave_connection      = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] database.sqlite_synchronous    = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.backend           = sqlalchemy {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.connection        = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.connection_debug  = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.connection_parameters =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.connection_recycle_time = 3600 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.connection_trace  = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.db_inc_retry_interval = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.db_max_retries    = 20 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.db_max_retry_interval = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.db_retry_interval = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.max_overflow      = 50 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.max_pool_size     = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.max_retries       = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.mysql_enable_ndb  = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.pool_timeout      = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.retry_interval    = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.slave_connection  = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] api_database.sqlite_synchronous = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] devices.enabled_mdev_types     = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ephemeral_storage_encryption.enabled = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.api_servers             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.cafile                  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.certfile                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.collect_timing          = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.connect_retries         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.connect_retry_delay     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.debug                   = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.default_trusted_certificate_ids = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.enable_certificate_validation = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.enable_rbd_download     = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.endpoint_override       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.insecure                = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.keyfile                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.max_version             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.min_version             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.num_retries             = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.rbd_ceph_conf           =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.rbd_connect_timeout     = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.rbd_pool                =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.rbd_user                =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.region_name             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.service_name            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.service_type            = image {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.split_loggers           = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.status_code_retries     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.status_code_retry_delay = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.timeout                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.verify_glance_signatures = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] glance.version                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] guestfs.debug                  = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.config_drive_cdrom      = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.config_drive_inject_password = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.enable_remotefx         = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.instances_path_share    =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.limit_cpu_features      = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.use_multipath_io        = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.vswitch_name            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] mks.enabled                    = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] image_cache.manager_interval   = 2400 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] image_cache.precache_concurrency = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] image_cache.remove_unused_base_images = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] image_cache.subdirectory_name  = _base {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.api_max_retries         = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.api_retry_interval      = 2 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.auth_section            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.auth_type               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.cafile                  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.certfile                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.collect_timing          = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.connect_retries         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.connect_retry_delay     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.endpoint_override       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.insecure                = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.keyfile                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.max_version             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.min_version             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.partition_key           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.peer_list               = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.region_name             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.serial_console_state_timeout = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.service_name            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.service_type            = baremetal {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.split_loggers           = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.status_code_retries     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.status_code_retry_delay = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.timeout                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ironic.version                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] key_manager.fixed_key          = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.barbican_api_version  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.barbican_endpoint     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.barbican_endpoint_type = public {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.barbican_region_name  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.cafile                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.certfile              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.collect_timing        = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.insecure              = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.keyfile               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.number_of_retries     = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.retry_delay           = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.send_service_user_token = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.split_loggers         = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.timeout               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.verify_ssl            = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican.verify_ssl_path       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican_service_user.auth_section = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican_service_user.auth_type = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican_service_user.cafile   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican_service_user.certfile = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican_service_user.collect_timing = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican_service_user.insecure = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican_service_user.keyfile  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican_service_user.split_loggers = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] barbican_service_user.timeout  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.approle_role_id          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.approle_secret_id        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.cafile                   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.certfile                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.collect_timing           = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.insecure                 = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.keyfile                  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.kv_mountpoint            = secret {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.kv_version               = 2 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.namespace                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.root_token_id            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.split_loggers            = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.ssl_ca_crt_file          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.timeout                  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.use_ssl                  = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.cafile                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.certfile              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.collect_timing        = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.connect_retries       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.connect_retry_delay   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.endpoint_override     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.insecure              = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.keyfile               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.max_version           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.min_version           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.region_name           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.service_name          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.service_type          = identity {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.split_loggers         = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.status_code_retries   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.status_code_retry_delay = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.timeout               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] keystone.version               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.connection_uri         =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.cpu_mode               = custom {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: WARNING oslo_config.cfg [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.cpu_power_governor_high = performance {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.cpu_power_management   = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.device_detach_attempts = 8 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.device_detach_timeout  = 20 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.disk_cachemodes        = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.disk_prefix            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.enabled_perf_events    = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.file_backed_memory     = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.gid_maps               = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.hw_disk_discard        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.hw_machine_type        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.images_rbd_pool        = rbd {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.images_type            = default {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.images_volume_group    = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.inject_key             = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.inject_partition       = -2 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.inject_password        = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.iscsi_iface            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.iser_use_multipath     = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_downtime = 500 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_inbound_addr = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_scheme  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_timeout_action = abort {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_tunnelled = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: WARNING oslo_config.cfg [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 01 08:04:17 user nova-compute[72426]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 01 08:04:17 user nova-compute[72426]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 01 08:04:17 user nova-compute[72426]: and ``live_migration_inbound_addr`` respectively.
Aug 01 08:04:17 user nova-compute[72426]: ).  Its value may be silently ignored in the future.
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.live_migration_with_native_tls = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.max_queues             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.nfs_mount_options      = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.num_pcie_ports         = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.pmem_namespaces        = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.quobyte_client_cfg     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.rbd_secret_uuid        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.rbd_user               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.rescue_image_id        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.rescue_kernel_id       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.rx_queue_size          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.smbfs_mount_options    =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.snapshot_compression   = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.snapshot_image_format  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.sparse_logical_volumes = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.swtpm_enabled          = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.swtpm_group            = tss {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.swtpm_user             = tss {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.sysinfo_serial         = unique {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.tb_cache_size          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.tx_queue_size          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.uid_maps               = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.use_virtio_for_bridges = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.virt_type              = kvm {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.volume_clear           = zero {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.volume_clear_size      = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.volume_use_multipath   = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.vzstorage_cache_path   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.auth_section           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.auth_type              = password {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.cafile                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.certfile               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.collect_timing         = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.connect_retries        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.connect_retry_delay    = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.default_floating_pool  = public {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.endpoint_override      = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.extension_sync_interval = 600 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.http_retries           = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.insecure               = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.keyfile                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.max_version            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.min_version            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.ovs_bridge             = br-int {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.physnets               = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.region_name            = RegionOne {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.service_metadata_proxy = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.service_name           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.service_type           = network {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.split_loggers          = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.status_code_retries    = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.status_code_retry_delay = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.timeout                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] neutron.version                = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] notifications.bdms_in_notifications = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] notifications.default_level    = INFO {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] notifications.notification_format = unversioned {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] notifications.notify_on_state_change = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] pci.alias                      = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] pci.device_spec                = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] pci.report_in_placement        = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.auth_section         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.auth_type            = password {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.cafile               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.certfile             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.collect_timing       = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.connect_retries      = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.connect_retry_delay  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.default_domain_id    = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.default_domain_name  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.domain_id            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.domain_name          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.endpoint_override    = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.insecure             = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.keyfile              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.max_version          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.min_version          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.password             = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.project_domain_id    = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.project_domain_name  = Default {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.project_id           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.project_name         = service {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.region_name          = RegionOne {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.service_name         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.service_type         = placement {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.split_loggers        = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.status_code_retries  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.status_code_retry_delay = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.system_scope         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.timeout              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.trust_id             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.user_domain_id       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.user_domain_name     = Default {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.user_id              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.username             = placement {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] placement.version              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.cores                    = 20 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.count_usage_from_placement = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.injected_file_content_bytes = 10240 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.injected_file_path_length = 255 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.injected_files           = 5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.instances                = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.key_pairs                = 100 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.metadata_items           = 128 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.ram                      = 51200 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.recheck_quota            = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.server_group_members     = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] quota.server_groups            = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] rdp.enabled                    = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.image_metadata_prefilter = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.max_attempts         = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.max_placement_results = 1000 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] scheduler.workers              = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.host_subset_size = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.isolated_hosts = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.isolated_images = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.pci_in_placement = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.track_instance_changes = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] metrics.required               = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] metrics.weight_multiplier      = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] metrics.weight_setting         = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] serial_console.enabled         = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] serial_console.port_range      = 10000:20000 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] serial_console.serialproxy_port = 6083 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_user.auth_section      = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_user.auth_type         = password {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_user.cafile            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_user.certfile          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_user.collect_timing    = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_user.insecure          = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_user.keyfile           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_user.send_service_user_token = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_user.split_loggers     = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] service_user.timeout           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.agent_enabled            = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.enabled                  = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.html5proxy_port          = 6082 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.image_compression        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.jpeg_compression         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.playback_compression     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.server_listen            = 127.0.0.1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.streaming_mode           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] spice.zlib_compression         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] upgrade_levels.baseapi         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] upgrade_levels.cert            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] upgrade_levels.compute         = auto {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] upgrade_levels.conductor       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] upgrade_levels.scheduler       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vendordata_dynamic_auth.cafile = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vendordata_dynamic_auth.certfile = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vendordata_dynamic_auth.insecure = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vendordata_dynamic_auth.timeout = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.api_retry_count         = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.ca_file                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.cache_prefix            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.cluster_name            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.connection_pool_size    = 10 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.console_delay_seconds   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.datastore_regex         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.host_ip                 = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.host_password           = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.host_port               = 443 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.host_username           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.insecure                = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.integration_bridge      = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.maximum_objects         = 100 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.pbm_default_policy      = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.pbm_enabled             = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.pbm_wsdl_location       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.serial_port_proxy_uri   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.serial_port_service_uri = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.task_poll_interval      = 0.5 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.use_linked_clone        = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.vnc_keymap              = en-us {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.vnc_port                = 5900 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vmware.vnc_port_total          = 10000 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vnc.auth_schemes               = ['none'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vnc.enabled                    = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vnc.novncproxy_port            = 6080 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vnc.vencrypt_ca_certs          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vnc.vencrypt_client_cert       = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vnc.vencrypt_client_key        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.disable_rootwrap   = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.enable_numa_live_migration = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.libvirt_disable_apic = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.client_socket_timeout     = 900 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.default_pool_size         = 1000 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.keep_alive                = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.max_header_line           = 16384 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.ssl_ca_file               = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.ssl_cert_file             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.ssl_key_file              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.tcp_keepidle              = 600 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] zvm.ca_file                    = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] zvm.cloud_connector_url        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] zvm.reachable_timeout          = 300 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_policy.enforce_new_defaults = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_policy.enforce_scope      = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_policy.policy_default_rule = default {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.connection_string     = messaging:// {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.enabled               = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.es_doc_type           = notification {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.es_scroll_size        = 10000 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.es_scroll_time        = 2m {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.filter_error_trace    = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.hmac_keys             = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.sentinel_service_name = mymaster {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.socket_timeout        = 0.1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.trace_requests        = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler.trace_sqlalchemy      = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler_jaeger.process_tags   = {} {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler_jaeger.service_name_prefix = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] profiler_otlp.service_name_prefix = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] remote_debug.host              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] remote_debug.port              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:17 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_notifications.retry = -1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.auth_section        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.auth_type           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.cafile              = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.certfile            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.collect_timing      = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.connect_retries     = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.connect_retry_delay = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.endpoint_id         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.endpoint_override   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.insecure            = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.keyfile             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.max_version         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.min_version         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.region_name         = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.service_name        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.service_type        = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.split_loggers       = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.status_code_retries = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.status_code_retry_delay = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.timeout             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.valid_interfaces    = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_limit.version             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_reports.file_event_handler = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] oslo_reports.log_dir           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_ovs_privileged.group  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] vif_plug_ovs_privileged.user   = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_ovs.isolate_vif         = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] os_brick.lock_path             = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] privsep_osbrick.capabilities   = [21] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] privsep_osbrick.group          = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] privsep_osbrick.helper_command = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] privsep_osbrick.user           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] nova_sys_admin.group           = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] nova_sys_admin.helper_command  = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] nova_sys_admin.user            = None {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG oslo_service.service [None req-f549a4f8-aae7-4d09-b47e-64eb12e64bf3 None None] ******************************************************************************** {{(pid=72426) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 01 08:04:18 user nova-compute[72426]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 01 08:04:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Starting native event thread {{(pid=72426) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Starting green dispatch thread {{(pid=72426) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Starting connection event dispatch thread {{(pid=72426) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Connecting to libvirt: qemu:///system {{(pid=72426) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f8c83feca60> {{(pid=72426) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 01 08:04:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f8c83feca60> {{(pid=72426) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 01 08:04:18 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Connection event '1' reason 'None'
Aug 01 08:04:18 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 08:04:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.mount [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Initialising _HostMountState generation 0 {{(pid=72426) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 01 08:04:25 user nova-compute[72426]: INFO nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Libvirt host capabilities <capabilities>
Aug 01 08:04:25 user nova-compute[72426]:   <host>
Aug 01 08:04:25 user nova-compute[72426]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 01 08:04:25 user nova-compute[72426]:     <cpu>
Aug 01 08:04:25 user nova-compute[72426]:       <arch>x86_64</arch>
Aug 01 08:04:25 user nova-compute[72426]:       <model>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <vendor>Intel</vendor>
Aug 01 08:04:25 user nova-compute[72426]:       <microcode version='1070'/>
Aug 01 08:04:25 user nova-compute[72426]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 01 08:04:25 user nova-compute[72426]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='ss'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='vmx'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='pcid'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='osxsave'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='hypervisor'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='arat'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='tsc_adjust'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='md-clear'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='arch-capabilities'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='invtsc'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='rsba'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature name='skip-l1dfl-vmentry'/>
Aug 01 08:04:25 user nova-compute[72426]:       <pages unit='KiB' size='4'/>
Aug 01 08:04:25 user nova-compute[72426]:       <pages unit='KiB' size='2048'/>
Aug 01 08:04:25 user nova-compute[72426]:     </cpu>
Aug 01 08:04:25 user nova-compute[72426]:     <power_management>
Aug 01 08:04:25 user nova-compute[72426]:       <suspend_mem/>
Aug 01 08:04:25 user nova-compute[72426]:       <suspend_disk/>
Aug 01 08:04:25 user nova-compute[72426]:       <suspend_hybrid/>
Aug 01 08:04:25 user nova-compute[72426]:     </power_management>
Aug 01 08:04:25 user nova-compute[72426]:     <iommu support='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     <migration_features>
Aug 01 08:04:25 user nova-compute[72426]:       <live/>
Aug 01 08:04:25 user nova-compute[72426]:       <uri_transports>
Aug 01 08:04:25 user nova-compute[72426]:         <uri_transport>tcp</uri_transport>
Aug 01 08:04:25 user nova-compute[72426]:         <uri_transport>rdma</uri_transport>
Aug 01 08:04:25 user nova-compute[72426]:       </uri_transports>
Aug 01 08:04:25 user nova-compute[72426]:     </migration_features>
Aug 01 08:04:25 user nova-compute[72426]:     <topology>
Aug 01 08:04:25 user nova-compute[72426]:       <cells num='2'>
Aug 01 08:04:25 user nova-compute[72426]:         <cell id='0'>
Aug 01 08:04:25 user nova-compute[72426]:           <memory unit='KiB'>8189224</memory>
Aug 01 08:04:25 user nova-compute[72426]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 01 08:04:25 user nova-compute[72426]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 08:04:25 user nova-compute[72426]:           <distances>
Aug 01 08:04:25 user nova-compute[72426]:             <sibling id='0' value='10'/>
Aug 01 08:04:25 user nova-compute[72426]:             <sibling id='1' value='20'/>
Aug 01 08:04:25 user nova-compute[72426]:           </distances>
Aug 01 08:04:25 user nova-compute[72426]:           <cpus num='6'>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 01 08:04:25 user nova-compute[72426]:           </cpus>
Aug 01 08:04:25 user nova-compute[72426]:         </cell>
Aug 01 08:04:25 user nova-compute[72426]:         <cell id='1'>
Aug 01 08:04:25 user nova-compute[72426]:           <memory unit='KiB'>8206460</memory>
Aug 01 08:04:25 user nova-compute[72426]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 01 08:04:25 user nova-compute[72426]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 08:04:25 user nova-compute[72426]:           <distances>
Aug 01 08:04:25 user nova-compute[72426]:             <sibling id='0' value='20'/>
Aug 01 08:04:25 user nova-compute[72426]:             <sibling id='1' value='10'/>
Aug 01 08:04:25 user nova-compute[72426]:           </distances>
Aug 01 08:04:25 user nova-compute[72426]:           <cpus num='6'>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 01 08:04:25 user nova-compute[72426]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 01 08:04:25 user nova-compute[72426]:           </cpus>
Aug 01 08:04:25 user nova-compute[72426]:         </cell>
Aug 01 08:04:25 user nova-compute[72426]:       </cells>
Aug 01 08:04:25 user nova-compute[72426]:     </topology>
Aug 01 08:04:25 user nova-compute[72426]:     <cache>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 01 08:04:25 user nova-compute[72426]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 01 08:04:25 user nova-compute[72426]:     </cache>
Aug 01 08:04:25 user nova-compute[72426]:     <secmodel>
Aug 01 08:04:25 user nova-compute[72426]:       <model>apparmor</model>
Aug 01 08:04:25 user nova-compute[72426]:       <doi>0</doi>
Aug 01 08:04:25 user nova-compute[72426]:     </secmodel>
Aug 01 08:04:25 user nova-compute[72426]:     <secmodel>
Aug 01 08:04:25 user nova-compute[72426]:       <model>dac</model>
Aug 01 08:04:25 user nova-compute[72426]:       <doi>0</doi>
Aug 01 08:04:25 user nova-compute[72426]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 01 08:04:25 user nova-compute[72426]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 01 08:04:25 user nova-compute[72426]:     </secmodel>
Aug 01 08:04:25 user nova-compute[72426]:   </host>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='alpha'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>clipper</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='armv6l'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>spitz</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>nuri</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>kzm</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sx1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>z2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>tosa</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>n810</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>n800</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>terrier</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>midway</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>microbit</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>verdex</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>highbank</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>akita</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>connex</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>collie</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='armv7l'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>spitz</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>nuri</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>kzm</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sx1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>z2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>tosa</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>n810</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>n800</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>terrier</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>midway</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>microbit</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>verdex</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>highbank</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>akita</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>connex</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>collie</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='aarch64'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>spitz</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>nuri</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>kzm</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sx1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>z2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>tosa</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>n810</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>n800</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>terrier</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>midway</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>microbit</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>verdex</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>raspi3b</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>highbank</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>akita</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>connex</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>collie</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <acpi default='on' toggle='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='cris'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='i686'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>isapc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>microvm</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='kvm'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <pae/>
Aug 01 08:04:25 user nova-compute[72426]:       <nonpae/>
Aug 01 08:04:25 user nova-compute[72426]:       <acpi default='on' toggle='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:       <apic default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='m68k'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>an5206</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>q800</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>next-cube</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='microblaze'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='microblazeel'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='mips'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='16'>malta</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='mipsel'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='16'>malta</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='mips64'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='16'>malta</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>pica61</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>magnum</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='mips64el'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='16'>malta</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>pica61</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>magnum</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='16'>boston</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='ppc'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mac99</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>40p</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>taihu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='ppc64'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>taihu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>40p</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mac99</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='ppc64le'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>taihu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>40p</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>mac99</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='riscv32'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='8'>spike</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>opentitan</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='8'>virt</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='riscv64'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='8'>spike</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>shakti_c</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='8'>virt</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='s390x'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='sh4'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>shix</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>r2d</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='sh4eb'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>shix</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>r2d</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='sparc'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>SS-5</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>SS-20</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>LX</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>SS-4</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>SS-10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>Voyager</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='sparc64'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sun4u</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>niagara</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>sun4v</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='x86_64'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>64</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='1'>isapc</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>microvm</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='kvm'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <acpi default='on' toggle='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:       <apic default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='xtensa'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>sim</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>kc705</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>ml605</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>virt</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>lx200</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>lx60</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]:   <guest>
Aug 01 08:04:25 user nova-compute[72426]:     <os_type>hvm</os_type>
Aug 01 08:04:25 user nova-compute[72426]:     <arch name='xtensaeb'>
Aug 01 08:04:25 user nova-compute[72426]:       <wordsize>32</wordsize>
Aug 01 08:04:25 user nova-compute[72426]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='4'>sim</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>kc705</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>ml605</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>virt</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>lx200</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>lx60</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 08:04:25 user nova-compute[72426]:       <domain type='qemu'/>
Aug 01 08:04:25 user nova-compute[72426]:     </arch>
Aug 01 08:04:25 user nova-compute[72426]:     <features>
Aug 01 08:04:25 user nova-compute[72426]:       <cpuselection/>
Aug 01 08:04:25 user nova-compute[72426]:       <deviceboot/>
Aug 01 08:04:25 user nova-compute[72426]:       <disksnapshot default='on' toggle='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     </features>
Aug 01 08:04:25 user nova-compute[72426]:   </guest>
Aug 01 08:04:25 user nova-compute[72426]: </capabilities>
Aug 01 08:04:25 user nova-compute[72426]: 
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 01 08:04:25 user nova-compute[72426]: <domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 08:04:25 user nova-compute[72426]:   <domain>kvm</domain>
Aug 01 08:04:25 user nova-compute[72426]:   <machine>pc-i440fx-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:   <arch>i686</arch>
Aug 01 08:04:25 user nova-compute[72426]:   <vcpu max='255'/>
Aug 01 08:04:25 user nova-compute[72426]:   <iothreads supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:   <os supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='firmware'/>
Aug 01 08:04:25 user nova-compute[72426]:     <loader supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>rom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pflash</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='readonly'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>yes</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='secure'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </loader>
Aug 01 08:04:25 user nova-compute[72426]:   </os>
Aug 01 08:04:25 user nova-compute[72426]:   <cpu>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-passthrough' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='hostPassthroughMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='maximum' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='maximumMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-model' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <vendor>Intel</vendor>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ss'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='vmx'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pcid'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='hypervisor'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arat'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='umip'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='md-clear'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibpb'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibrs'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='erms'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='lm'/>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='custom' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>qemu64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>qemu32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>phenom</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>n270</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>kvm64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>coreduo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>core2duo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>athlon</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Westmere</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Snowridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Penryn</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G5</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G4</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G1</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Nehalem</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Rome</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Milan</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Dhyana</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cooperlake</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Conroe</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>486</model>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:   </cpu>
Aug 01 08:04:25 user nova-compute[72426]:   <memoryBacking supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='sourceType'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>file</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>anonymous</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>memfd</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:   </memoryBacking>
Aug 01 08:04:25 user nova-compute[72426]:   <devices>
Aug 01 08:04:25 user nova-compute[72426]:     <disk supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='diskDevice'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>disk</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cdrom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>floppy</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>lun</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='bus'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ide</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>fdc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sata</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </disk>
Aug 01 08:04:25 user nova-compute[72426]:     <graphics supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sdl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vnc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>spice</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egl-headless</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </graphics>
Aug 01 08:04:25 user nova-compute[72426]:     <video supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='modelType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cirrus</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vmvga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>qxl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>none</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>bochs</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ramfb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </video>
Aug 01 08:04:25 user nova-compute[72426]:     <hostdev supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='mode'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>subsystem</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='startupPolicy'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>default</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>mandatory</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>requisite</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>optional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='subsysType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pci</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='capsType'/>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='pciBackend'/>
Aug 01 08:04:25 user nova-compute[72426]:     </hostdev>
Aug 01 08:04:25 user nova-compute[72426]:     <rng supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>random</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egd</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>builtin</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </rng>
Aug 01 08:04:25 user nova-compute[72426]:     <filesystem supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='driverType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>path</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>handle</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtiofs</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </filesystem>
Aug 01 08:04:25 user nova-compute[72426]:     <tpm supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-tis</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-crb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>passthrough</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>emulator</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </tpm>
Aug 01 08:04:25 user nova-compute[72426]:   </devices>
Aug 01 08:04:25 user nova-compute[72426]:   <features>
Aug 01 08:04:25 user nova-compute[72426]:     <gic supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     <vmcoreinfo supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <genid supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backingStoreInput supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backup supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <sev supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:   </features>
Aug 01 08:04:25 user nova-compute[72426]: </domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:  {{(pid=72426) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 01 08:04:25 user nova-compute[72426]: <domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 08:04:25 user nova-compute[72426]:   <domain>kvm</domain>
Aug 01 08:04:25 user nova-compute[72426]:   <machine>pc-i440fx-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:   <arch>i686</arch>
Aug 01 08:04:25 user nova-compute[72426]:   <vcpu max='255'/>
Aug 01 08:04:25 user nova-compute[72426]:   <iothreads supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:   <os supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='firmware'/>
Aug 01 08:04:25 user nova-compute[72426]:     <loader supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>rom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pflash</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='readonly'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>yes</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='secure'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </loader>
Aug 01 08:04:25 user nova-compute[72426]:   </os>
Aug 01 08:04:25 user nova-compute[72426]:   <cpu>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-passthrough' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='hostPassthroughMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='maximum' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='maximumMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-model' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <vendor>Intel</vendor>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ss'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='vmx'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pcid'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='hypervisor'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arat'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='umip'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='md-clear'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibpb'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibrs'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='erms'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='lm'/>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='custom' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>qemu64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>qemu32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>phenom</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>n270</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>kvm64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>coreduo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>core2duo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>athlon</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Westmere</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Snowridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Penryn</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G5</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G4</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G1</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Nehalem</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Rome</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Milan</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Dhyana</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cooperlake</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Conroe</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>486</model>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:   </cpu>
Aug 01 08:04:25 user nova-compute[72426]:   <memoryBacking supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='sourceType'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>file</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>anonymous</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>memfd</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:   </memoryBacking>
Aug 01 08:04:25 user nova-compute[72426]:   <devices>
Aug 01 08:04:25 user nova-compute[72426]:     <disk supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='diskDevice'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>disk</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cdrom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>floppy</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>lun</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='bus'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ide</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>fdc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sata</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </disk>
Aug 01 08:04:25 user nova-compute[72426]:     <graphics supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sdl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vnc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>spice</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egl-headless</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </graphics>
Aug 01 08:04:25 user nova-compute[72426]:     <video supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='modelType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cirrus</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vmvga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>qxl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>none</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>bochs</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ramfb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </video>
Aug 01 08:04:25 user nova-compute[72426]:     <hostdev supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='mode'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>subsystem</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='startupPolicy'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>default</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>mandatory</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>requisite</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>optional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='subsysType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pci</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='capsType'/>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='pciBackend'/>
Aug 01 08:04:25 user nova-compute[72426]:     </hostdev>
Aug 01 08:04:25 user nova-compute[72426]:     <rng supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>random</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egd</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>builtin</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </rng>
Aug 01 08:04:25 user nova-compute[72426]:     <filesystem supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='driverType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>path</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>handle</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtiofs</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </filesystem>
Aug 01 08:04:25 user nova-compute[72426]:     <tpm supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-tis</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-crb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>passthrough</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>emulator</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </tpm>
Aug 01 08:04:25 user nova-compute[72426]:   </devices>
Aug 01 08:04:25 user nova-compute[72426]:   <features>
Aug 01 08:04:25 user nova-compute[72426]:     <gic supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     <vmcoreinfo supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <genid supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backingStoreInput supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backup supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <sev supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:   </features>
Aug 01 08:04:25 user nova-compute[72426]: </domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:  {{(pid=72426) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 01 08:04:25 user nova-compute[72426]: <domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 08:04:25 user nova-compute[72426]:   <domain>kvm</domain>
Aug 01 08:04:25 user nova-compute[72426]:   <machine>pc-q35-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:   <arch>i686</arch>
Aug 01 08:04:25 user nova-compute[72426]:   <vcpu max='288'/>
Aug 01 08:04:25 user nova-compute[72426]:   <iothreads supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:   <os supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='firmware'/>
Aug 01 08:04:25 user nova-compute[72426]:     <loader supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>rom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pflash</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='readonly'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>yes</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='secure'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </loader>
Aug 01 08:04:25 user nova-compute[72426]:   </os>
Aug 01 08:04:25 user nova-compute[72426]:   <cpu>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-passthrough' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='hostPassthroughMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='maximum' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='maximumMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-model' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <vendor>Intel</vendor>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ss'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='vmx'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pcid'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='hypervisor'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arat'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='umip'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='md-clear'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibpb'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibrs'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='erms'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='lm'/>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='custom' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>qemu64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>qemu32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>phenom</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>n270</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>kvm64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>coreduo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>core2duo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>athlon</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Westmere</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Snowridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Penryn</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G5</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G4</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G1</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Nehalem</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Rome</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Milan</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Dhyana</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cooperlake</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Conroe</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>486</model>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:   </cpu>
Aug 01 08:04:25 user nova-compute[72426]:   <memoryBacking supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='sourceType'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>file</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>anonymous</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>memfd</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:   </memoryBacking>
Aug 01 08:04:25 user nova-compute[72426]:   <devices>
Aug 01 08:04:25 user nova-compute[72426]:     <disk supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='diskDevice'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>disk</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cdrom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>floppy</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>lun</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='bus'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>fdc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sata</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </disk>
Aug 01 08:04:25 user nova-compute[72426]:     <graphics supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sdl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vnc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>spice</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egl-headless</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </graphics>
Aug 01 08:04:25 user nova-compute[72426]:     <video supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='modelType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cirrus</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vmvga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>qxl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>none</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>bochs</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ramfb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </video>
Aug 01 08:04:25 user nova-compute[72426]:     <hostdev supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='mode'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>subsystem</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='startupPolicy'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>default</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>mandatory</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>requisite</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>optional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='subsysType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pci</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='capsType'/>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='pciBackend'/>
Aug 01 08:04:25 user nova-compute[72426]:     </hostdev>
Aug 01 08:04:25 user nova-compute[72426]:     <rng supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>random</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egd</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>builtin</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </rng>
Aug 01 08:04:25 user nova-compute[72426]:     <filesystem supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='driverType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>path</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>handle</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtiofs</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </filesystem>
Aug 01 08:04:25 user nova-compute[72426]:     <tpm supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-tis</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-crb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>passthrough</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>emulator</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </tpm>
Aug 01 08:04:25 user nova-compute[72426]:   </devices>
Aug 01 08:04:25 user nova-compute[72426]:   <features>
Aug 01 08:04:25 user nova-compute[72426]:     <gic supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     <vmcoreinfo supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <genid supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backingStoreInput supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backup supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <sev supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:   </features>
Aug 01 08:04:25 user nova-compute[72426]: </domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:  {{(pid=72426) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 01 08:04:25 user nova-compute[72426]: <domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 08:04:25 user nova-compute[72426]:   <domain>kvm</domain>
Aug 01 08:04:25 user nova-compute[72426]:   <machine>pc-q35-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:   <arch>i686</arch>
Aug 01 08:04:25 user nova-compute[72426]:   <vcpu max='288'/>
Aug 01 08:04:25 user nova-compute[72426]:   <iothreads supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:   <os supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='firmware'/>
Aug 01 08:04:25 user nova-compute[72426]:     <loader supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>rom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pflash</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='readonly'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>yes</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='secure'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </loader>
Aug 01 08:04:25 user nova-compute[72426]:   </os>
Aug 01 08:04:25 user nova-compute[72426]:   <cpu>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-passthrough' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='hostPassthroughMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='maximum' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='maximumMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-model' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <vendor>Intel</vendor>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ss'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='vmx'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pcid'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='hypervisor'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arat'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='umip'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='md-clear'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibpb'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibrs'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='erms'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='lm'/>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='custom' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>qemu64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>qemu32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>phenom</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>n270</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>kvm64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>coreduo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>core2duo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>athlon</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Westmere</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Snowridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Penryn</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G5</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G4</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G1</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Nehalem</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Rome</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Milan</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Dhyana</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cooperlake</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Conroe</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>486</model>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:   </cpu>
Aug 01 08:04:25 user nova-compute[72426]:   <memoryBacking supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='sourceType'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>file</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>anonymous</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>memfd</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:   </memoryBacking>
Aug 01 08:04:25 user nova-compute[72426]:   <devices>
Aug 01 08:04:25 user nova-compute[72426]:     <disk supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='diskDevice'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>disk</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cdrom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>floppy</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>lun</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='bus'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>fdc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sata</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </disk>
Aug 01 08:04:25 user nova-compute[72426]:     <graphics supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sdl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vnc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>spice</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egl-headless</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </graphics>
Aug 01 08:04:25 user nova-compute[72426]:     <video supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='modelType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cirrus</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vmvga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>qxl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>none</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>bochs</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ramfb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </video>
Aug 01 08:04:25 user nova-compute[72426]:     <hostdev supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='mode'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>subsystem</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='startupPolicy'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>default</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>mandatory</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>requisite</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>optional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='subsysType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pci</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='capsType'/>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='pciBackend'/>
Aug 01 08:04:25 user nova-compute[72426]:     </hostdev>
Aug 01 08:04:25 user nova-compute[72426]:     <rng supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>random</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egd</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>builtin</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </rng>
Aug 01 08:04:25 user nova-compute[72426]:     <filesystem supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='driverType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>path</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>handle</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtiofs</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </filesystem>
Aug 01 08:04:25 user nova-compute[72426]:     <tpm supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-tis</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-crb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>passthrough</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>emulator</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </tpm>
Aug 01 08:04:25 user nova-compute[72426]:   </devices>
Aug 01 08:04:25 user nova-compute[72426]:   <features>
Aug 01 08:04:25 user nova-compute[72426]:     <gic supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     <vmcoreinfo supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <genid supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backingStoreInput supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backup supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <sev supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:   </features>
Aug 01 08:04:25 user nova-compute[72426]: </domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:  {{(pid=72426) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 01 08:04:25 user nova-compute[72426]: <domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 08:04:25 user nova-compute[72426]:   <domain>kvm</domain>
Aug 01 08:04:25 user nova-compute[72426]:   <machine>pc-i440fx-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:   <arch>x86_64</arch>
Aug 01 08:04:25 user nova-compute[72426]:   <vcpu max='255'/>
Aug 01 08:04:25 user nova-compute[72426]:   <iothreads supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:   <os supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='firmware'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>efi</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:     <loader supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>rom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pflash</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='readonly'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>yes</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='secure'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </loader>
Aug 01 08:04:25 user nova-compute[72426]:   </os>
Aug 01 08:04:25 user nova-compute[72426]:   <cpu>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-passthrough' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='hostPassthroughMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='maximum' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='maximumMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-model' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <vendor>Intel</vendor>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ss'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='vmx'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pcid'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='hypervisor'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arat'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='umip'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='md-clear'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='invtsc'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibpb'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibrs'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='rsba'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='erms'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='custom' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>qemu64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>qemu32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>phenom</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>n270</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>coreduo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>core2duo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>athlon</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Westmere</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Snowridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Penryn</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G5</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G4</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Opteron_G1</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Nehalem</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Rome</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Milan</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Dhyana</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cooperlake</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Conroe</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>486</model>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:   </cpu>
Aug 01 08:04:25 user nova-compute[72426]:   <memoryBacking supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='sourceType'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>file</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>anonymous</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>memfd</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:   </memoryBacking>
Aug 01 08:04:25 user nova-compute[72426]:   <devices>
Aug 01 08:04:25 user nova-compute[72426]:     <disk supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='diskDevice'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>disk</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cdrom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>floppy</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>lun</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='bus'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ide</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>fdc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sata</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </disk>
Aug 01 08:04:25 user nova-compute[72426]:     <graphics supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sdl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vnc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>spice</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egl-headless</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </graphics>
Aug 01 08:04:25 user nova-compute[72426]:     <video supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='modelType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cirrus</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vmvga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>qxl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>none</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>bochs</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ramfb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </video>
Aug 01 08:04:25 user nova-compute[72426]:     <hostdev supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='mode'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>subsystem</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='startupPolicy'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>default</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>mandatory</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>requisite</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>optional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='subsysType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pci</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='capsType'/>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='pciBackend'/>
Aug 01 08:04:25 user nova-compute[72426]:     </hostdev>
Aug 01 08:04:25 user nova-compute[72426]:     <rng supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>random</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egd</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>builtin</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </rng>
Aug 01 08:04:25 user nova-compute[72426]:     <filesystem supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='driverType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>path</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>handle</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtiofs</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </filesystem>
Aug 01 08:04:25 user nova-compute[72426]:     <tpm supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-tis</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-crb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>passthrough</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>emulator</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </tpm>
Aug 01 08:04:25 user nova-compute[72426]:   </devices>
Aug 01 08:04:25 user nova-compute[72426]:   <features>
Aug 01 08:04:25 user nova-compute[72426]:     <gic supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     <vmcoreinfo supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <genid supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backingStoreInput supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backup supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <sev supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:   </features>
Aug 01 08:04:25 user nova-compute[72426]: </domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:  {{(pid=72426) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 01 08:04:25 user nova-compute[72426]: <domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 08:04:25 user nova-compute[72426]:   <domain>kvm</domain>
Aug 01 08:04:25 user nova-compute[72426]:   <machine>pc-i440fx-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:   <arch>x86_64</arch>
Aug 01 08:04:25 user nova-compute[72426]:   <vcpu max='255'/>
Aug 01 08:04:25 user nova-compute[72426]:   <iothreads supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:   <os supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='firmware'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>efi</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:     <loader supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>rom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pflash</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='readonly'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>yes</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='secure'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </loader>
Aug 01 08:04:25 user nova-compute[72426]:   </os>
Aug 01 08:04:25 user nova-compute[72426]:   <cpu>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-passthrough' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='hostPassthroughMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='maximum' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='maximumMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-model' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <vendor>Intel</vendor>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ss'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='vmx'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pcid'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='hypervisor'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arat'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='umip'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='md-clear'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='invtsc'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibpb'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibrs'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='rsba'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='erms'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='custom' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>qemu64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>qemu32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>phenom</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>n270</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>coreduo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>core2duo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>athlon</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Westmere</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Snowridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Penryn</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G5</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G4</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Opteron_G1</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Nehalem</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Rome</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Milan</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Dhyana</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cooperlake</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Conroe</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>486</model>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:   </cpu>
Aug 01 08:04:25 user nova-compute[72426]:   <memoryBacking supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='sourceType'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>file</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>anonymous</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>memfd</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:   </memoryBacking>
Aug 01 08:04:25 user nova-compute[72426]:   <devices>
Aug 01 08:04:25 user nova-compute[72426]:     <disk supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='diskDevice'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>disk</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cdrom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>floppy</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>lun</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='bus'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ide</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>fdc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sata</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </disk>
Aug 01 08:04:25 user nova-compute[72426]:     <graphics supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sdl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vnc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>spice</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egl-headless</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </graphics>
Aug 01 08:04:25 user nova-compute[72426]:     <video supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='modelType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cirrus</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vmvga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>qxl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>none</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>bochs</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ramfb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </video>
Aug 01 08:04:25 user nova-compute[72426]:     <hostdev supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='mode'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>subsystem</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='startupPolicy'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>default</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>mandatory</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>requisite</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>optional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='subsysType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pci</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='capsType'/>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='pciBackend'/>
Aug 01 08:04:25 user nova-compute[72426]:     </hostdev>
Aug 01 08:04:25 user nova-compute[72426]:     <rng supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>random</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egd</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>builtin</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </rng>
Aug 01 08:04:25 user nova-compute[72426]:     <filesystem supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='driverType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>path</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>handle</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtiofs</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </filesystem>
Aug 01 08:04:25 user nova-compute[72426]:     <tpm supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-tis</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-crb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>passthrough</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>emulator</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </tpm>
Aug 01 08:04:25 user nova-compute[72426]:   </devices>
Aug 01 08:04:25 user nova-compute[72426]:   <features>
Aug 01 08:04:25 user nova-compute[72426]:     <gic supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     <vmcoreinfo supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <genid supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backingStoreInput supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backup supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <sev supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:   </features>
Aug 01 08:04:25 user nova-compute[72426]: </domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:  {{(pid=72426) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 01 08:04:25 user nova-compute[72426]: <domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 08:04:25 user nova-compute[72426]:   <domain>kvm</domain>
Aug 01 08:04:25 user nova-compute[72426]:   <machine>pc-q35-jammy</machine>
Aug 01 08:04:25 user nova-compute[72426]:   <arch>x86_64</arch>
Aug 01 08:04:25 user nova-compute[72426]:   <vcpu max='288'/>
Aug 01 08:04:25 user nova-compute[72426]:   <iothreads supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:   <os supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='firmware'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>efi</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:     <loader supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>rom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pflash</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='readonly'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>yes</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='secure'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>yes</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </loader>
Aug 01 08:04:25 user nova-compute[72426]:   </os>
Aug 01 08:04:25 user nova-compute[72426]:   <cpu>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-passthrough' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='hostPassthroughMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='maximum' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='maximumMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-model' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <vendor>Intel</vendor>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ss'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='vmx'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pcid'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='hypervisor'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arat'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='umip'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='md-clear'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='invtsc'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibpb'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibrs'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='rsba'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='erms'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='custom' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>qemu64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>qemu32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>phenom</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>n270</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>coreduo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>core2duo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>athlon</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Westmere</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Snowridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Penryn</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G5</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G4</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Opteron_G1</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Nehalem</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Rome</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Milan</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Dhyana</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cooperlake</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Conroe</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>486</model>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:   </cpu>
Aug 01 08:04:25 user nova-compute[72426]:   <memoryBacking supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='sourceType'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>file</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>anonymous</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>memfd</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:   </memoryBacking>
Aug 01 08:04:25 user nova-compute[72426]:   <devices>
Aug 01 08:04:25 user nova-compute[72426]:     <disk supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='diskDevice'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>disk</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cdrom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>floppy</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>lun</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='bus'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>fdc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sata</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </disk>
Aug 01 08:04:25 user nova-compute[72426]:     <graphics supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sdl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vnc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>spice</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egl-headless</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </graphics>
Aug 01 08:04:25 user nova-compute[72426]:     <video supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='modelType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cirrus</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vmvga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>qxl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>none</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>bochs</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ramfb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </video>
Aug 01 08:04:25 user nova-compute[72426]:     <hostdev supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='mode'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>subsystem</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='startupPolicy'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>default</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>mandatory</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>requisite</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>optional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='subsysType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pci</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='capsType'/>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='pciBackend'/>
Aug 01 08:04:25 user nova-compute[72426]:     </hostdev>
Aug 01 08:04:25 user nova-compute[72426]:     <rng supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>random</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egd</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>builtin</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </rng>
Aug 01 08:04:25 user nova-compute[72426]:     <filesystem supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='driverType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>path</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>handle</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtiofs</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </filesystem>
Aug 01 08:04:25 user nova-compute[72426]:     <tpm supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-tis</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-crb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>passthrough</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>emulator</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </tpm>
Aug 01 08:04:25 user nova-compute[72426]:   </devices>
Aug 01 08:04:25 user nova-compute[72426]:   <features>
Aug 01 08:04:25 user nova-compute[72426]:     <gic supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     <vmcoreinfo supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <genid supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backingStoreInput supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backup supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <sev supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:   </features>
Aug 01 08:04:25 user nova-compute[72426]: </domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:  {{(pid=72426) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 01 08:04:25 user nova-compute[72426]: <domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 08:04:25 user nova-compute[72426]:   <domain>kvm</domain>
Aug 01 08:04:25 user nova-compute[72426]:   <machine>pc-q35-6.2</machine>
Aug 01 08:04:25 user nova-compute[72426]:   <arch>x86_64</arch>
Aug 01 08:04:25 user nova-compute[72426]:   <vcpu max='288'/>
Aug 01 08:04:25 user nova-compute[72426]:   <iothreads supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:   <os supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='firmware'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>efi</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:     <loader supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>rom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pflash</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='readonly'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>yes</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='secure'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>yes</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>no</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </loader>
Aug 01 08:04:25 user nova-compute[72426]:   </os>
Aug 01 08:04:25 user nova-compute[72426]:   <cpu>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-passthrough' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='hostPassthroughMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='maximum' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='maximumMigratable'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>on</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>off</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='host-model' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <vendor>Intel</vendor>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ss'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='vmx'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pcid'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='hypervisor'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arat'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='umip'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='md-clear'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='invtsc'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibpb'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='ibrs'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-stibp'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='rsba'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='erms'/>
Aug 01 08:04:25 user nova-compute[72426]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:     <mode name='custom' supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>qemu64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>qemu32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>phenom</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>pentium</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>n270</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm64</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>kvm32</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>coreduo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>core2duo</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>athlon</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Westmere</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Snowridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Skylake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>SandyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Penryn</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G5</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G4</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G3</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Opteron_G2</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Opteron_G1</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Nehalem</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>IvyBridge</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Icelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Haswell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Rome</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-Milan</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>EPYC</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Dhyana</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cooperlake</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>Conroe</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='no'>Broadwell</model>
Aug 01 08:04:25 user nova-compute[72426]:       <model usable='yes'>486</model>
Aug 01 08:04:25 user nova-compute[72426]:     </mode>
Aug 01 08:04:25 user nova-compute[72426]:   </cpu>
Aug 01 08:04:25 user nova-compute[72426]:   <memoryBacking supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:     <enum name='sourceType'>
Aug 01 08:04:25 user nova-compute[72426]:       <value>file</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>anonymous</value>
Aug 01 08:04:25 user nova-compute[72426]:       <value>memfd</value>
Aug 01 08:04:25 user nova-compute[72426]:     </enum>
Aug 01 08:04:25 user nova-compute[72426]:   </memoryBacking>
Aug 01 08:04:25 user nova-compute[72426]:   <devices>
Aug 01 08:04:25 user nova-compute[72426]:     <disk supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='diskDevice'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>disk</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cdrom</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>floppy</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>lun</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='bus'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>fdc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sata</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </disk>
Aug 01 08:04:25 user nova-compute[72426]:     <graphics supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='type'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>sdl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vnc</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>spice</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egl-headless</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </graphics>
Aug 01 08:04:25 user nova-compute[72426]:     <video supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='modelType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>cirrus</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>vmvga</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>qxl</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>none</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>bochs</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>ramfb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </video>
Aug 01 08:04:25 user nova-compute[72426]:     <hostdev supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='mode'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>subsystem</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='startupPolicy'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>default</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>mandatory</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>requisite</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>optional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='subsysType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>usb</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>pci</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>scsi</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='capsType'/>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='pciBackend'/>
Aug 01 08:04:25 user nova-compute[72426]:     </hostdev>
Aug 01 08:04:25 user nova-compute[72426]:     <rng supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtio-non-transitional</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>random</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>egd</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>builtin</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </rng>
Aug 01 08:04:25 user nova-compute[72426]:     <filesystem supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='driverType'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>path</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>handle</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>virtiofs</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </filesystem>
Aug 01 08:04:25 user nova-compute[72426]:     <tpm supported='yes'>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='model'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-tis</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>tpm-crb</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:       <enum name='backendModel'>
Aug 01 08:04:25 user nova-compute[72426]:         <value>passthrough</value>
Aug 01 08:04:25 user nova-compute[72426]:         <value>emulator</value>
Aug 01 08:04:25 user nova-compute[72426]:       </enum>
Aug 01 08:04:25 user nova-compute[72426]:     </tpm>
Aug 01 08:04:25 user nova-compute[72426]:   </devices>
Aug 01 08:04:25 user nova-compute[72426]:   <features>
Aug 01 08:04:25 user nova-compute[72426]:     <gic supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:     <vmcoreinfo supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <genid supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backingStoreInput supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <backup supported='yes'/>
Aug 01 08:04:25 user nova-compute[72426]:     <sev supported='no'/>
Aug 01 08:04:25 user nova-compute[72426]:   </features>
Aug 01 08:04:25 user nova-compute[72426]: </domainCapabilities>
Aug 01 08:04:25 user nova-compute[72426]:  {{(pid=72426) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72426) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72426) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Checking secure boot support for host arch (x86_64) {{(pid=72426) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Checking secure boot support for host arch (x86_64) {{(pid=72426) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Checking secure boot support for host arch (x86_64) {{(pid=72426) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Checking secure boot support for host arch (x86_64) {{(pid=72426) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Checking secure boot support for host arch (x86_64) {{(pid=72426) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 08:04:25 user nova-compute[72426]: INFO nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Secure Boot support detected
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] cpu compare xml: <cpu match="exact">
Aug 01 08:04:25 user nova-compute[72426]:   <model>Nehalem</model>
Aug 01 08:04:25 user nova-compute[72426]: </cpu>
Aug 01 08:04:25 user nova-compute[72426]:  {{(pid=72426) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 01 08:04:25 user nova-compute[72426]: INFO nova.virt.node [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Generated node identity 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99
Aug 01 08:04:25 user nova-compute[72426]: INFO nova.virt.node [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Wrote node identity 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 to /opt/stack/data/nova/compute_id
Aug 01 08:04:25 user nova-compute[72426]: WARNING nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Compute nodes ['857b4ca4-2f0e-4cc5-bf9a-50b98073ab99'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 01 08:04:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 01 08:04:25 user nova-compute[72426]: WARNING nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 08:04:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:04:25 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:04:25 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:04:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Hypervisor/Node resource view: name=user free_ram=10861MB free_disk=26.47647476196289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:04:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:04:25 user nova-compute[72426]: WARNING nova.compute.resource_tracker [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] No compute node record for user:857b4ca4-2f0e-4cc5-bf9a-50b98073ab99: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 could not be found.
Aug 01 08:04:26 user nova-compute[72426]: INFO nova.compute.resource_tracker [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Compute node record created for user:user with uuid: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:04:26 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [req-525a88ff-cf5f-4e18-b223-b6aad161d848] Created resource provider record via placement API for resource provider with UUID 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 and name user.
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72426) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 01 08:04:26 user nova-compute[72426]: INFO nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] kernel doesn't support AMD SEV
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Updating inventory in ProviderTree for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Libvirt baseline CPU <cpu>
Aug 01 08:04:26 user nova-compute[72426]:   <arch>x86_64</arch>
Aug 01 08:04:26 user nova-compute[72426]:   <model>Nehalem</model>
Aug 01 08:04:26 user nova-compute[72426]:   <vendor>Intel</vendor>
Aug 01 08:04:26 user nova-compute[72426]:   <topology sockets="6" cores="1" threads="1"/>
Aug 01 08:04:26 user nova-compute[72426]: </cpu>
Aug 01 08:04:26 user nova-compute[72426]:  {{(pid=72426) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Updated inventory for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Updating resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 generation from 0 to 1 during operation: update_inventory {{(pid=72426) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Updating inventory in ProviderTree for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Updating resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 generation from 1 to 2 during operation: update_traits {{(pid=72426) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.687s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.service [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Creating RPC server for service compute {{(pid=72426) start /opt/stack/nova/nova/service.py:182}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.service [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Join ServiceGroup membership for this service compute {{(pid=72426) start /opt/stack/nova/nova/service.py:199}}
Aug 01 08:04:26 user nova-compute[72426]: DEBUG nova.servicegroup.drivers.db [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72426) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:05:18 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:05:19 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:05:19 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:05:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=10222MB free_disk=26.38019561767578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:05:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:05:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:05:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:05:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:05:19 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:05:19 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:05:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:05:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:05:19 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:06:17 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:06:18 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:06:18 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:06:18 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=10215MB free_disk=26.426773071289062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:06:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:06:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:06:18 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:06:18 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:06:18 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:06:18 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:06:18 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:06:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:06:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:06:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:06:19 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:07:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:07:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:07:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:07:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:07:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:07:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:07:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:07:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:07:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:07:19 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:07:19 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:07:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=10217MB free_disk=26.199249267578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:07:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:07:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:07:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:08:19 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:08:19 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:08:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=9481MB free_disk=26.230133056640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:08:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:08:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:08:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:08:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:21 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:21 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:08:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:08:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:29 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:08:29 user nova-compute[72426]: INFO nova.compute.claims [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Claim successful on node user
Aug 01 08:08:30 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:08:30 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:08:30 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:08:30 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Creating image(s)
Aug 01 08:08:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "/opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "/opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "/opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9.part --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:31 user nova-compute[72426]: DEBUG nova.policy [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'decf869dd36044cf9f59e37c338ff0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388b1904f2c2472abebf36d33593183a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:08:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9.part --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:31 user nova-compute[72426]: DEBUG nova.virt.images [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] d15c2a71-abe5-4334-bf77-67be8f572ede was qcow2, converting to raw {{(pid=72426) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 08:08:31 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:08:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9.part /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9.converted {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9.part /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9.converted" returned: 0 in 0.194s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9.converted --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9.converted --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.573s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:32 user nova-compute[72426]: INFO oslo.privsep.daemon [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqbh_s2k1/privsep.sock']
Aug 01 08:08:32 user sudo[81560]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqbh_s2k1/privsep.sock
Aug 01 08:08:32 user sudo[81560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 08:08:33 user sudo[81560]: pam_unix(sudo:session): session closed for user root
Aug 01 08:08:33 user nova-compute[72426]: INFO oslo.privsep.daemon [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Spawned new privsep daemon via rootwrap
Aug 01 08:08:33 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 08:08:33 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 08:08:33 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 01 08:08:33 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81563
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.225s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.126s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk 1073741824" returned: 0 in 0.086s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Successfully created port: d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Cannot resize image /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lazy-loading 'migration_context' on Instance uuid 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Ensure instance console log exists: /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "c10d6140-aa17-4342-9135-d07a73285483" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "c10d6140-aa17-4342-9135-d07a73285483" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:08:35 user nova-compute[72426]: INFO nova.compute.claims [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Claim successful on node user
Aug 01 08:08:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:08:35 user nova-compute[72426]: INFO nova.compute.claims [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Claim successful on node user
Aug 01 08:08:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:08:35 user nova-compute[72426]: DEBUG nova.network.neutron [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:08:35 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:08:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Creating image(s)
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "/opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "/opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "/opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.127s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:08:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.policy [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '184d71425948492e835ea8f0dd857d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b6971ed0a343468f071e1e25c27d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk 1073741824" returned: 0 in 0.045s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:08:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Creating image(s)
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "/opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "/opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "/opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.123s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Cannot resize image /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'migration_context' on Instance uuid c10d6140-aa17-4342-9135-d07a73285483 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Ensure instance console log exists: /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.125s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk 1073741824" returned: 0 in 0.043s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:08:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:37 user nova-compute[72426]: DEBUG nova.policy [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63a663fe54d7469a97f5642e0847a2d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77facd98c6ac4726939b5599e6c72a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:08:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:37 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Cannot resize image /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:08:37 user nova-compute[72426]: DEBUG nova.objects.instance [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'migration_context' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:08:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:08:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Ensure instance console log exists: /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:08:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Successfully updated port: d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:08:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "refresh_cache-223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:08:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquired lock "refresh_cache-223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:08:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:08:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:08:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-eeb3e3ef-b4fe-4e71-a2cf-84f5793461fb req-99a2d40b-ad5c-4e13-ad99-39b55b5b5f18 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Received event network-changed-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-eeb3e3ef-b4fe-4e71-a2cf-84f5793461fb req-99a2d40b-ad5c-4e13-ad99-39b55b5b5f18 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Refreshing instance network info cache due to event network-changed-d1b41d27-7b3c-4f7b-b823-7e1b3f835922. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:08:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-eeb3e3ef-b4fe-4e71-a2cf-84f5793461fb req-99a2d40b-ad5c-4e13-ad99-39b55b5b5f18 service nova] Acquiring lock "refresh_cache-223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:08:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Successfully created port: 48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Successfully created port: 883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Updating instance_info_cache with network_info: [{"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Releasing lock "refresh_cache-223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Instance network_info: |[{"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-eeb3e3ef-b4fe-4e71-a2cf-84f5793461fb req-99a2d40b-ad5c-4e13-ad99-39b55b5b5f18 service nova] Acquired lock "refresh_cache-223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.network.neutron [req-eeb3e3ef-b4fe-4e71-a2cf-84f5793461fb req-99a2d40b-ad5c-4e13-ad99-39b55b5b5f18 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Refreshing network info cache for port d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Start _get_guest_xml network_info=[{"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:08:40 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:08:40 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1965145044',display_name='tempest-DeleteServersTestJSON-server-1965145044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1965145044',id=1,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='388b1904f2c2472abebf36d33593183a',ramdisk_id='',reservation_id='r-3h74iogq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-588657060',owner_user_name='tempest-DeleteServersTestJSON-588657060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:08:30Z,user_data=None,user_id='decf869dd36044cf9f59e37c338ff0e5',uuid=223b6e2a-f0fc-46e7-93e2-7e6a98abba8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Converting VIF {"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c8:44,bridge_name='br-int',has_traffic_filtering=True,id=d1b41d27-7b3c-4f7b-b823-7e1b3f835922,network=Network(3ebb75c1-9889-4132-ae11-4a4992bc34b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b41d27-7b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lazy-loading 'pci_devices' on Instance uuid 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:08:40 user nova-compute[72426]:   <uuid>223b6e2a-f0fc-46e7-93e2-7e6a98abba8a</uuid>
Aug 01 08:08:40 user nova-compute[72426]:   <name>instance-00000001</name>
Aug 01 08:08:40 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:08:40 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:08:40 user nova-compute[72426]:   <metadata>
Aug 01 08:08:40 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:08:40 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:08:40 user nova-compute[72426]:       <nova:name>tempest-DeleteServersTestJSON-server-1965145044</nova:name>
Aug 01 08:08:40 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:08:40</nova:creationTime>
Aug 01 08:08:40 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:08:40 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:08:40 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:08:40 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:08:40 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:08:40 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:08:40 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:08:40 user nova-compute[72426]:       <nova:owner>
Aug 01 08:08:40 user nova-compute[72426]:         <nova:user uuid="decf869dd36044cf9f59e37c338ff0e5">tempest-DeleteServersTestJSON-588657060-project-member</nova:user>
Aug 01 08:08:40 user nova-compute[72426]:         <nova:project uuid="388b1904f2c2472abebf36d33593183a">tempest-DeleteServersTestJSON-588657060</nova:project>
Aug 01 08:08:40 user nova-compute[72426]:       </nova:owner>
Aug 01 08:08:40 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:08:40 user nova-compute[72426]:       <nova:ports>
Aug 01 08:08:40 user nova-compute[72426]:         <nova:port uuid="d1b41d27-7b3c-4f7b-b823-7e1b3f835922">
Aug 01 08:08:40 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 08:08:40 user nova-compute[72426]:         </nova:port>
Aug 01 08:08:40 user nova-compute[72426]:       </nova:ports>
Aug 01 08:08:40 user nova-compute[72426]:     </nova:instance>
Aug 01 08:08:40 user nova-compute[72426]:   </metadata>
Aug 01 08:08:40 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:08:40 user nova-compute[72426]:     <system>
Aug 01 08:08:40 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:08:40 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:08:40 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:08:40 user nova-compute[72426]:       <entry name="serial">223b6e2a-f0fc-46e7-93e2-7e6a98abba8a</entry>
Aug 01 08:08:40 user nova-compute[72426]:       <entry name="uuid">223b6e2a-f0fc-46e7-93e2-7e6a98abba8a</entry>
Aug 01 08:08:40 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:08:40 user nova-compute[72426]:     </system>
Aug 01 08:08:40 user nova-compute[72426]:   </sysinfo>
Aug 01 08:08:40 user nova-compute[72426]:   <os>
Aug 01 08:08:40 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:08:40 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:08:40 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:08:40 user nova-compute[72426]:   </os>
Aug 01 08:08:40 user nova-compute[72426]:   <features>
Aug 01 08:08:40 user nova-compute[72426]:     <acpi/>
Aug 01 08:08:40 user nova-compute[72426]:     <apic/>
Aug 01 08:08:40 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:08:40 user nova-compute[72426]:   </features>
Aug 01 08:08:40 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:08:40 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:08:40 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:08:40 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:08:40 user nova-compute[72426]:   </clock>
Aug 01 08:08:40 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:08:40 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:08:40 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:08:40 user nova-compute[72426]:   </cpu>
Aug 01 08:08:40 user nova-compute[72426]:   <devices>
Aug 01 08:08:40 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:08:40 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:08:40 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk"/>
Aug 01 08:08:40 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:08:40 user nova-compute[72426]:     </disk>
Aug 01 08:08:40 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:08:40 user nova-compute[72426]:       <mac address="fa:16:3e:b9:c8:44"/>
Aug 01 08:08:40 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:08:40 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:08:40 user nova-compute[72426]:       <target dev="tapd1b41d27-7b"/>
Aug 01 08:08:40 user nova-compute[72426]:     </interface>
Aug 01 08:08:40 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:08:40 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/console.log" append="off"/>
Aug 01 08:08:40 user nova-compute[72426]:     </serial>
Aug 01 08:08:40 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:08:40 user nova-compute[72426]:     <video>
Aug 01 08:08:40 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:08:40 user nova-compute[72426]:     </video>
Aug 01 08:08:40 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:08:40 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:08:40 user nova-compute[72426]:     </rng>
Aug 01 08:08:40 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:08:40 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:08:40 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:08:40 user nova-compute[72426]:     </memballoon>
Aug 01 08:08:40 user nova-compute[72426]:   </devices>
Aug 01 08:08:40 user nova-compute[72426]: </domain>
Aug 01 08:08:40 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1965145044',display_name='tempest-DeleteServersTestJSON-server-1965145044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1965145044',id=1,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='388b1904f2c2472abebf36d33593183a',ramdisk_id='',reservation_id='r-3h74iogq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-588657060',owner_user_name='tempest-DeleteServersTestJSON-588657060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:08:30Z,user_data=None,user_id='decf869dd36044cf9f59e37c338ff0e5',uuid=223b6e2a-f0fc-46e7-93e2-7e6a98abba8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Converting VIF {"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c8:44,bridge_name='br-int',has_traffic_filtering=True,id=d1b41d27-7b3c-4f7b-b823-7e1b3f835922,network=Network(3ebb75c1-9889-4132-ae11-4a4992bc34b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b41d27-7b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG os_vif [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c8:44,bridge_name='br-int',has_traffic_filtering=True,id=d1b41d27-7b3c-4f7b-b823-7e1b3f835922,network=Network(3ebb75c1-9889-4132-ae11-4a4992bc34b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b41d27-7b') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Created schema index Interface.name {{(pid=72426) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Created schema index Port.name {{(pid=72426) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Created schema index Bridge.name {{(pid=72426) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [POLLOUT] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:08:40 user nova-compute[72426]: INFO oslo.privsep.daemon [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpsckvhpdp/privsep.sock']
Aug 01 08:08:40 user sudo[81635]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpsckvhpdp/privsep.sock
Aug 01 08:08:40 user sudo[81635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 08:08:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:41 user nova-compute[72426]: DEBUG nova.network.neutron [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Successfully updated port: 48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:08:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:08:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquired lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:08:41 user nova-compute[72426]: DEBUG nova.network.neutron [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG nova.network.neutron [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:08:42 user sudo[81635]: pam_unix(sudo:session): session closed for user root
Aug 01 08:08:42 user nova-compute[72426]: INFO oslo.privsep.daemon [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Spawned new privsep daemon via rootwrap
Aug 01 08:08:42 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 08:08:42 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 08:08:42 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 01 08:08:42 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81640
Aug 01 08:08:42 user nova-compute[72426]: DEBUG nova.network.neutron [req-eeb3e3ef-b4fe-4e71-a2cf-84f5793461fb req-99a2d40b-ad5c-4e13-ad99-39b55b5b5f18 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Updated VIF entry in instance network info cache for port d1b41d27-7b3c-4f7b-b823-7e1b3f835922. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG nova.network.neutron [req-eeb3e3ef-b4fe-4e71-a2cf-84f5793461fb req-99a2d40b-ad5c-4e13-ad99-39b55b5b5f18 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Updating instance_info_cache with network_info: [{"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-eeb3e3ef-b4fe-4e71-a2cf-84f5793461fb req-99a2d40b-ad5c-4e13-ad99-39b55b5b5f18 service nova] Releasing lock "refresh_cache-223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG nova.compute.manager [req-31cdf6bb-2e43-4c0e-997e-373d7b901cad req-72899d82-efb5-4350-a68f-832b958549d9 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Received event network-changed-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG nova.compute.manager [req-31cdf6bb-2e43-4c0e-997e-373d7b901cad req-72899d82-efb5-4350-a68f-832b958549d9 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Refreshing instance network info cache due to event network-changed-48ea1e7a-7adf-4836-bed4-5de3edd22ac1. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-31cdf6bb-2e43-4c0e-997e-373d7b901cad req-72899d82-efb5-4350-a68f-832b958549d9 service nova] Acquiring lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1b41d27-7b, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1b41d27-7b, col_values=(('external_ids', {'iface-id': 'd1b41d27-7b3c-4f7b-b823-7e1b3f835922', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:c8:44', 'vm-uuid': '223b6e2a-f0fc-46e7-93e2-7e6a98abba8a'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:42 user nova-compute[72426]: INFO os_vif [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c8:44,bridge_name='br-int',has_traffic_filtering=True,id=d1b41d27-7b3c-4f7b-b823-7e1b3f835922,network=Network(3ebb75c1-9889-4132-ae11-4a4992bc34b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b41d27-7b')
Aug 01 08:08:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] No VIF found with MAC fa:16:3e:b9:c8:44, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:08:42 user nova-compute[72426]: INFO nova.compute.claims [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Claim successful on node user
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Successfully updated port: 883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquired lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updating instance_info_cache with network_info: [{"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Releasing lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Instance network_info: |[{"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-31cdf6bb-2e43-4c0e-997e-373d7b901cad req-72899d82-efb5-4350-a68f-832b958549d9 service nova] Acquired lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.network.neutron [req-31cdf6bb-2e43-4c0e-997e-373d7b901cad req-72899d82-efb5-4350-a68f-832b958549d9 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Refreshing network info cache for port 48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Start _get_guest_xml network_info=[{"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:08:43 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:08:43 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334645290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-334645290',id=2,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-n09a5vh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:08:36Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=c10d6140-aa17-4342-9135-d07a73285483,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=48ea1e7a-7adf-4836-bed4-5de3edd22ac1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ea1e7a-7a') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.objects.instance [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'pci_devices' on Instance uuid c10d6140-aa17-4342-9135-d07a73285483 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:08:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:08:43 user nova-compute[72426]:   <uuid>c10d6140-aa17-4342-9135-d07a73285483</uuid>
Aug 01 08:08:43 user nova-compute[72426]:   <name>instance-00000002</name>
Aug 01 08:08:43 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:08:43 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:08:43 user nova-compute[72426]:   <metadata>
Aug 01 08:08:43 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:08:43 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:08:43 user nova-compute[72426]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-334645290</nova:name>
Aug 01 08:08:43 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:08:43</nova:creationTime>
Aug 01 08:08:43 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:08:43 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:08:43 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:08:43 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:08:43 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:08:43 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:08:43 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:08:43 user nova-compute[72426]:       <nova:owner>
Aug 01 08:08:43 user nova-compute[72426]:         <nova:user uuid="184d71425948492e835ea8f0dd857d1f">tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member</nova:user>
Aug 01 08:08:43 user nova-compute[72426]:         <nova:project uuid="d0b6971ed0a343468f071e1e25c27d5b">tempest-ServerBootFromVolumeStableRescueTest-2030640431</nova:project>
Aug 01 08:08:43 user nova-compute[72426]:       </nova:owner>
Aug 01 08:08:43 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:08:43 user nova-compute[72426]:       <nova:ports>
Aug 01 08:08:43 user nova-compute[72426]:         <nova:port uuid="48ea1e7a-7adf-4836-bed4-5de3edd22ac1">
Aug 01 08:08:43 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 08:08:43 user nova-compute[72426]:         </nova:port>
Aug 01 08:08:43 user nova-compute[72426]:       </nova:ports>
Aug 01 08:08:43 user nova-compute[72426]:     </nova:instance>
Aug 01 08:08:43 user nova-compute[72426]:   </metadata>
Aug 01 08:08:43 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:08:43 user nova-compute[72426]:     <system>
Aug 01 08:08:43 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:08:43 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:08:43 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:08:43 user nova-compute[72426]:       <entry name="serial">c10d6140-aa17-4342-9135-d07a73285483</entry>
Aug 01 08:08:43 user nova-compute[72426]:       <entry name="uuid">c10d6140-aa17-4342-9135-d07a73285483</entry>
Aug 01 08:08:43 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:08:43 user nova-compute[72426]:     </system>
Aug 01 08:08:43 user nova-compute[72426]:   </sysinfo>
Aug 01 08:08:43 user nova-compute[72426]:   <os>
Aug 01 08:08:43 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:08:43 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:08:43 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:08:43 user nova-compute[72426]:   </os>
Aug 01 08:08:43 user nova-compute[72426]:   <features>
Aug 01 08:08:43 user nova-compute[72426]:     <acpi/>
Aug 01 08:08:43 user nova-compute[72426]:     <apic/>
Aug 01 08:08:43 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:08:43 user nova-compute[72426]:   </features>
Aug 01 08:08:43 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:08:43 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:08:43 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:08:43 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:08:43 user nova-compute[72426]:   </clock>
Aug 01 08:08:43 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:08:43 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:08:43 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:08:43 user nova-compute[72426]:   </cpu>
Aug 01 08:08:43 user nova-compute[72426]:   <devices>
Aug 01 08:08:43 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:08:43 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:08:43 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk"/>
Aug 01 08:08:43 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:08:43 user nova-compute[72426]:     </disk>
Aug 01 08:08:43 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:08:43 user nova-compute[72426]:       <mac address="fa:16:3e:ef:a2:b8"/>
Aug 01 08:08:43 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:08:43 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:08:43 user nova-compute[72426]:       <target dev="tap48ea1e7a-7a"/>
Aug 01 08:08:43 user nova-compute[72426]:     </interface>
Aug 01 08:08:43 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:08:43 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/console.log" append="off"/>
Aug 01 08:08:43 user nova-compute[72426]:     </serial>
Aug 01 08:08:43 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:08:43 user nova-compute[72426]:     <video>
Aug 01 08:08:43 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:08:43 user nova-compute[72426]:     </video>
Aug 01 08:08:43 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:08:43 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:08:43 user nova-compute[72426]:     </rng>
Aug 01 08:08:43 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:08:43 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:08:43 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:08:43 user nova-compute[72426]:     </memballoon>
Aug 01 08:08:43 user nova-compute[72426]:   </devices>
Aug 01 08:08:43 user nova-compute[72426]: </domain>
Aug 01 08:08:43 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334645290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-334645290',id=2,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-n09a5vh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:08:36Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=c10d6140-aa17-4342-9135-d07a73285483,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=48ea1e7a-7adf-4836-bed4-5de3edd22ac1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ea1e7a-7a') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG os_vif [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=48ea1e7a-7adf-4836-bed4-5de3edd22ac1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ea1e7a-7a') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48ea1e7a-7a, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48ea1e7a-7a, col_values=(('external_ids', {'iface-id': '48ea1e7a-7adf-4836-bed4-5de3edd22ac1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:a2:b8', 'vm-uuid': 'c10d6140-aa17-4342-9135-d07a73285483'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:43 user nova-compute[72426]: INFO os_vif [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=48ea1e7a-7adf-4836-bed4-5de3edd22ac1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ea1e7a-7a')
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No VIF found with MAC fa:16:3e:ef:a2:b8, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.policy [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fec3b4665a148e498a731cfeef7f589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d0ba9feb9244e88cb3945f553c8ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:08:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Creating image(s)
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "/opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "/opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "/opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk 1073741824" returned: 0 in 0.043s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.125s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Cannot resize image /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.objects.instance [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'migration_context' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Ensure instance console log exists: /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-d3c1a312-89a1-42fe-9ced-a667c281549b req-fd395c28-3679-44de-863e-f7de306c60bc service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-changed-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-d3c1a312-89a1-42fe-9ced-a667c281549b req-fd395c28-3679-44de-863e-f7de306c60bc service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Refreshing instance network info cache due to event network-changed-883a5e52-3445-4ce9-aebd-8a5c59e18e63. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d3c1a312-89a1-42fe-9ced-a667c281549b req-fd395c28-3679-44de-863e-f7de306c60bc service nova] Acquiring lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.network.neutron [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updating instance_info_cache with network_info: [{"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Releasing lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Instance network_info: |[{"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d3c1a312-89a1-42fe-9ced-a667c281549b req-fd395c28-3679-44de-863e-f7de306c60bc service nova] Acquired lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.network.neutron [req-d3c1a312-89a1-42fe-9ced-a667c281549b req-fd395c28-3679-44de-863e-f7de306c60bc service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Refreshing network info cache for port 883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Start _get_guest_xml network_info=[{"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:08:44 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:08:44 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-118503701',display_name='tempest-ServerActionsTestOtherA-server-118503701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-118503701',id=3,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-rcue7ywk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=df66e0b7-acbf-48a2-b165-7d4a4fbf790d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.objects.instance [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'pci_devices' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:08:44 user nova-compute[72426]:   <uuid>df66e0b7-acbf-48a2-b165-7d4a4fbf790d</uuid>
Aug 01 08:08:44 user nova-compute[72426]:   <name>instance-00000003</name>
Aug 01 08:08:44 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:08:44 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:08:44 user nova-compute[72426]:   <metadata>
Aug 01 08:08:44 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:08:44 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:08:44 user nova-compute[72426]:       <nova:name>tempest-ServerActionsTestOtherA-server-118503701</nova:name>
Aug 01 08:08:44 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:08:44</nova:creationTime>
Aug 01 08:08:44 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:08:44 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:08:44 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:08:44 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:08:44 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:08:44 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:08:44 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:08:44 user nova-compute[72426]:       <nova:owner>
Aug 01 08:08:44 user nova-compute[72426]:         <nova:user uuid="63a663fe54d7469a97f5642e0847a2d4">tempest-ServerActionsTestOtherA-355781192-project-member</nova:user>
Aug 01 08:08:44 user nova-compute[72426]:         <nova:project uuid="77facd98c6ac4726939b5599e6c72a9b">tempest-ServerActionsTestOtherA-355781192</nova:project>
Aug 01 08:08:44 user nova-compute[72426]:       </nova:owner>
Aug 01 08:08:44 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:08:44 user nova-compute[72426]:       <nova:ports>
Aug 01 08:08:44 user nova-compute[72426]:         <nova:port uuid="883a5e52-3445-4ce9-aebd-8a5c59e18e63">
Aug 01 08:08:44 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 08:08:44 user nova-compute[72426]:         </nova:port>
Aug 01 08:08:44 user nova-compute[72426]:       </nova:ports>
Aug 01 08:08:44 user nova-compute[72426]:     </nova:instance>
Aug 01 08:08:44 user nova-compute[72426]:   </metadata>
Aug 01 08:08:44 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:08:44 user nova-compute[72426]:     <system>
Aug 01 08:08:44 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:08:44 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:08:44 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:08:44 user nova-compute[72426]:       <entry name="serial">df66e0b7-acbf-48a2-b165-7d4a4fbf790d</entry>
Aug 01 08:08:44 user nova-compute[72426]:       <entry name="uuid">df66e0b7-acbf-48a2-b165-7d4a4fbf790d</entry>
Aug 01 08:08:44 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:08:44 user nova-compute[72426]:     </system>
Aug 01 08:08:44 user nova-compute[72426]:   </sysinfo>
Aug 01 08:08:44 user nova-compute[72426]:   <os>
Aug 01 08:08:44 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:08:44 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:08:44 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:08:44 user nova-compute[72426]:   </os>
Aug 01 08:08:44 user nova-compute[72426]:   <features>
Aug 01 08:08:44 user nova-compute[72426]:     <acpi/>
Aug 01 08:08:44 user nova-compute[72426]:     <apic/>
Aug 01 08:08:44 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:08:44 user nova-compute[72426]:   </features>
Aug 01 08:08:44 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:08:44 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:08:44 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:08:44 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:08:44 user nova-compute[72426]:   </clock>
Aug 01 08:08:44 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:08:44 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:08:44 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:08:44 user nova-compute[72426]:   </cpu>
Aug 01 08:08:44 user nova-compute[72426]:   <devices>
Aug 01 08:08:44 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:08:44 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:08:44 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk"/>
Aug 01 08:08:44 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:08:44 user nova-compute[72426]:     </disk>
Aug 01 08:08:44 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:08:44 user nova-compute[72426]:       <mac address="fa:16:3e:83:20:2c"/>
Aug 01 08:08:44 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:08:44 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:08:44 user nova-compute[72426]:       <target dev="tap883a5e52-34"/>
Aug 01 08:08:44 user nova-compute[72426]:     </interface>
Aug 01 08:08:44 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:08:44 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/console.log" append="off"/>
Aug 01 08:08:44 user nova-compute[72426]:     </serial>
Aug 01 08:08:44 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:08:44 user nova-compute[72426]:     <video>
Aug 01 08:08:44 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:08:44 user nova-compute[72426]:     </video>
Aug 01 08:08:44 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:08:44 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:08:44 user nova-compute[72426]:     </rng>
Aug 01 08:08:44 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:08:44 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:08:44 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:08:44 user nova-compute[72426]:     </memballoon>
Aug 01 08:08:44 user nova-compute[72426]:   </devices>
Aug 01 08:08:44 user nova-compute[72426]: </domain>
Aug 01 08:08:44 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-118503701',display_name='tempest-ServerActionsTestOtherA-server-118503701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-118503701',id=3,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-rcue7ywk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=df66e0b7-acbf-48a2-b165-7d4a4fbf790d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG os_vif [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap883a5e52-34, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap883a5e52-34, col_values=(('external_ids', {'iface-id': '883a5e52-3445-4ce9-aebd-8a5c59e18e63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:20:2c', 'vm-uuid': 'df66e0b7-acbf-48a2-b165-7d4a4fbf790d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:44 user nova-compute[72426]: INFO os_vif [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34')
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:08:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No VIF found with MAC fa:16:3e:83:20:2c, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:08:45 user nova-compute[72426]: DEBUG nova.network.neutron [req-31cdf6bb-2e43-4c0e-997e-373d7b901cad req-72899d82-efb5-4350-a68f-832b958549d9 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updated VIF entry in instance network info cache for port 48ea1e7a-7adf-4836-bed4-5de3edd22ac1. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:08:45 user nova-compute[72426]: DEBUG nova.network.neutron [req-31cdf6bb-2e43-4c0e-997e-373d7b901cad req-72899d82-efb5-4350-a68f-832b958549d9 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updating instance_info_cache with network_info: [{"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:08:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-31cdf6bb-2e43-4c0e-997e-373d7b901cad req-72899d82-efb5-4350-a68f-832b958549d9 service nova] Releasing lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:08:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-769f4ea0-028d-4c00-9925-ea48fbef9981 req-08ab04ca-17f4-4101-9317-1596ad122052 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Received event network-vif-plugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-769f4ea0-028d-4c00-9925-ea48fbef9981 req-08ab04ca-17f4-4101-9317-1596ad122052 service nova] Acquiring lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-769f4ea0-028d-4c00-9925-ea48fbef9981 req-08ab04ca-17f4-4101-9317-1596ad122052 service nova] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-769f4ea0-028d-4c00-9925-ea48fbef9981 req-08ab04ca-17f4-4101-9317-1596ad122052 service nova] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-769f4ea0-028d-4c00-9925-ea48fbef9981 req-08ab04ca-17f4-4101-9317-1596ad122052 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] No waiting events found dispatching network-vif-plugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:08:45 user nova-compute[72426]: WARNING nova.compute.manager [req-769f4ea0-028d-4c00-9925-ea48fbef9981 req-08ab04ca-17f4-4101-9317-1596ad122052 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Received unexpected event network-vif-plugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 for instance with vm_state building and task_state spawning.
Aug 01 08:08:45 user nova-compute[72426]: DEBUG nova.network.neutron [req-d3c1a312-89a1-42fe-9ced-a667c281549b req-fd395c28-3679-44de-863e-f7de306c60bc service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updated VIF entry in instance network info cache for port 883a5e52-3445-4ce9-aebd-8a5c59e18e63. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:08:45 user nova-compute[72426]: DEBUG nova.network.neutron [req-d3c1a312-89a1-42fe-9ced-a667c281549b req-fd395c28-3679-44de-863e-f7de306c60bc service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updating instance_info_cache with network_info: [{"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:08:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d3c1a312-89a1-42fe-9ced-a667c281549b req-fd395c28-3679-44de-863e-f7de306c60bc service nova] Releasing lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:08:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Successfully created port: 197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:08:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-1f5c9742-1b0e-45fc-aaf6-0f0cd4f26089 req-34f7d005-82a9-495e-bb43-6d92fa087d8d service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Received event network-vif-plugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1f5c9742-1b0e-45fc-aaf6-0f0cd4f26089 req-34f7d005-82a9-495e-bb43-6d92fa087d8d service nova] Acquiring lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1f5c9742-1b0e-45fc-aaf6-0f0cd4f26089 req-34f7d005-82a9-495e-bb43-6d92fa087d8d service nova] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1f5c9742-1b0e-45fc-aaf6-0f0cd4f26089 req-34f7d005-82a9-495e-bb43-6d92fa087d8d service nova] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-1f5c9742-1b0e-45fc-aaf6-0f0cd4f26089 req-34f7d005-82a9-495e-bb43-6d92fa087d8d service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] No waiting events found dispatching network-vif-plugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:08:47 user nova-compute[72426]: WARNING nova.compute.manager [req-1f5c9742-1b0e-45fc-aaf6-0f0cd4f26089 req-34f7d005-82a9-495e-bb43-6d92fa087d8d service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Received unexpected event network-vif-plugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 for instance with vm_state building and task_state spawning.
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-55a13b98-62df-4fab-8188-630d1f40cd7f req-e7539466-d409-46eb-ae63-9429ab2a1254 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-55a13b98-62df-4fab-8188-630d1f40cd7f req-e7539466-d409-46eb-ae63-9429ab2a1254 service nova] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-55a13b98-62df-4fab-8188-630d1f40cd7f req-e7539466-d409-46eb-ae63-9429ab2a1254 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-55a13b98-62df-4fab-8188-630d1f40cd7f req-e7539466-d409-46eb-ae63-9429ab2a1254 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-55a13b98-62df-4fab-8188-630d1f40cd7f req-e7539466-d409-46eb-ae63-9429ab2a1254 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] No waiting events found dispatching network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:08:48 user nova-compute[72426]: WARNING nova.compute.manager [req-55a13b98-62df-4fab-8188-630d1f40cd7f req-e7539466-d409-46eb-ae63-9429ab2a1254 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received unexpected event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 for instance with vm_state building and task_state spawning.
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877328.1074593, 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:08:48 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] VM Resumed (Lifecycle Event)
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:08:48 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Instance spawned successfully.
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:08:48 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877328.1192088, 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:08:48 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] VM Started (Lifecycle Event)
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:08:48 user nova-compute[72426]: INFO nova.compute.manager [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Took 17.80 seconds to spawn the instance on the hypervisor.
Aug 01 08:08:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:48 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:08:48 user nova-compute[72426]: INFO nova.compute.manager [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Took 18.66 seconds to build instance.
Aug 01 08:08:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8c695a56-1e86-4b00-9aad-5c69a59ae32b tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.988s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Successfully updated port: 197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Received event network-vif-plugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] Acquiring lock "c10d6140-aa17-4342-9135-d07a73285483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] Lock "c10d6140-aa17-4342-9135-d07a73285483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] Lock "c10d6140-aa17-4342-9135-d07a73285483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] No waiting events found dispatching network-vif-plugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:08:49 user nova-compute[72426]: WARNING nova.compute.manager [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Received unexpected event network-vif-plugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 for instance with vm_state building and task_state spawning.
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Received event network-vif-plugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] Acquiring lock "c10d6140-aa17-4342-9135-d07a73285483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] Lock "c10d6140-aa17-4342-9135-d07a73285483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] Lock "c10d6140-aa17-4342-9135-d07a73285483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] No waiting events found dispatching network-vif-plugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:08:49 user nova-compute[72426]: WARNING nova.compute.manager [req-156b4ed5-d2e9-443d-ad25-631fadc47a1a req-779f4e20-3efe-4f2a-b45e-0d11614cf139 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Received unexpected event network-vif-plugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 for instance with vm_state building and task_state spawning.
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877329.6461666, c10d6140-aa17-4342-9135-d07a73285483 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:08:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] VM Resumed (Lifecycle Event)
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquired lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:08:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: c10d6140-aa17-4342-9135-d07a73285483] Instance spawned successfully.
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877329.6505253, c10d6140-aa17-4342-9135-d07a73285483 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:08:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] VM Started (Lifecycle Event)
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:08:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Instance spawned successfully.
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:08:49 user nova-compute[72426]: INFO nova.compute.manager [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Took 13.74 seconds to spawn the instance on the hypervisor.
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877329.8607357, df66e0b7-acbf-48a2-b165-7d4a4fbf790d => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:08:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] VM Resumed (Lifecycle Event)
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:08:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:08:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:08:50 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877329.8611197, df66e0b7-acbf-48a2-b165-7d4a4fbf790d => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:08:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] VM Started (Lifecycle Event)
Aug 01 08:08:50 user nova-compute[72426]: INFO nova.compute.manager [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Took 14.59 seconds to build instance.
Aug 01 08:08:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:08:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:08:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-36b72074-f455-4eb8-b0a8-e9e8877b4eee tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "c10d6140-aa17-4342-9135-d07a73285483" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.932s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-7314a13d-e450-45c2-88e2-ca5e205622f8 req-34abfe29-757c-4fea-9c8a-53fe24e8a8af service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7314a13d-e450-45c2-88e2-ca5e205622f8 req-34abfe29-757c-4fea-9c8a-53fe24e8a8af service nova] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7314a13d-e450-45c2-88e2-ca5e205622f8 req-34abfe29-757c-4fea-9c8a-53fe24e8a8af service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7314a13d-e450-45c2-88e2-ca5e205622f8 req-34abfe29-757c-4fea-9c8a-53fe24e8a8af service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-7314a13d-e450-45c2-88e2-ca5e205622f8 req-34abfe29-757c-4fea-9c8a-53fe24e8a8af service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] No waiting events found dispatching network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:08:50 user nova-compute[72426]: WARNING nova.compute.manager [req-7314a13d-e450-45c2-88e2-ca5e205622f8 req-34abfe29-757c-4fea-9c8a-53fe24e8a8af service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received unexpected event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 for instance with vm_state building and task_state spawning.
Aug 01 08:08:50 user nova-compute[72426]: INFO nova.compute.manager [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Took 13.68 seconds to spawn the instance on the hypervisor.
Aug 01 08:08:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:50 user nova-compute[72426]: INFO nova.compute.manager [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Took 14.45 seconds to build instance.
Aug 01 08:08:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-51e1e652-aa88-4539-95f3-fc9073cd38cd tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.581s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-daeb5383-4ac8-4878-a460-56003ea4355e req-bd9c7169-adbe-454e-ad55-5f8ff483d7f1 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-changed-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-daeb5383-4ac8-4878-a460-56003ea4355e req-bd9c7169-adbe-454e-ad55-5f8ff483d7f1 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Refreshing instance network info cache due to event network-changed-197ec10c-39a4-4c89-b675-b7bb2ee90b1f. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-daeb5383-4ac8-4878-a460-56003ea4355e req-bd9c7169-adbe-454e-ad55-5f8ff483d7f1 service nova] Acquiring lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance_info_cache with network_info: [{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Releasing lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance network_info: |[{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-daeb5383-4ac8-4878-a460-56003ea4355e req-bd9c7169-adbe-454e-ad55-5f8ff483d7f1 service nova] Acquired lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.network.neutron [req-daeb5383-4ac8-4878-a460-56003ea4355e req-bd9c7169-adbe-454e-ad55-5f8ff483d7f1 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Refreshing network info cache for port 197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Start _get_guest_xml network_info=[{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:08:51 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:08:51 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-422374365',display_name='tempest-ServerActionsTestOtherB-server-422374365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-422374365',id=4,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl2oApS4LEi4Ig2bO8yUSo9wl16TwUkqqncZenLkty2XY524bkKbL5wZtWU4/2TUExag9ZWoRoLkyDVuWFoEcjk8zjc/94JyqcQHN/o4NaNjQ0nXMRCRju0bzFZ7w6HLQ==',key_name='tempest-keypair-1006503589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d0ba9feb9244e88cb3945f553c8ac7',ramdisk_id='',reservation_id='r-zqp59lbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-252722777',owner_user_name='tempest-ServerActionsTestOtherB-252722777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:08:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fec3b4665a148e498a731cfeef7f589',uuid=dad9feb1-d5fa-4ed2-9fe3-1573010446f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converting VIF {"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:08:51 user nova-compute[72426]: DEBUG nova.objects.instance [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'pci_devices' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:08:52 user nova-compute[72426]:   <uuid>dad9feb1-d5fa-4ed2-9fe3-1573010446f6</uuid>
Aug 01 08:08:52 user nova-compute[72426]:   <name>instance-00000004</name>
Aug 01 08:08:52 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:08:52 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:08:52 user nova-compute[72426]:   <metadata>
Aug 01 08:08:52 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:08:52 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:08:52 user nova-compute[72426]:       <nova:name>tempest-ServerActionsTestOtherB-server-422374365</nova:name>
Aug 01 08:08:52 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:08:51</nova:creationTime>
Aug 01 08:08:52 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:08:52 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:08:52 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:08:52 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:08:52 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:08:52 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:08:52 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:08:52 user nova-compute[72426]:       <nova:owner>
Aug 01 08:08:52 user nova-compute[72426]:         <nova:user uuid="4fec3b4665a148e498a731cfeef7f589">tempest-ServerActionsTestOtherB-252722777-project-member</nova:user>
Aug 01 08:08:52 user nova-compute[72426]:         <nova:project uuid="32d0ba9feb9244e88cb3945f553c8ac7">tempest-ServerActionsTestOtherB-252722777</nova:project>
Aug 01 08:08:52 user nova-compute[72426]:       </nova:owner>
Aug 01 08:08:52 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:08:52 user nova-compute[72426]:       <nova:ports>
Aug 01 08:08:52 user nova-compute[72426]:         <nova:port uuid="197ec10c-39a4-4c89-b675-b7bb2ee90b1f">
Aug 01 08:08:52 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 08:08:52 user nova-compute[72426]:         </nova:port>
Aug 01 08:08:52 user nova-compute[72426]:       </nova:ports>
Aug 01 08:08:52 user nova-compute[72426]:     </nova:instance>
Aug 01 08:08:52 user nova-compute[72426]:   </metadata>
Aug 01 08:08:52 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:08:52 user nova-compute[72426]:     <system>
Aug 01 08:08:52 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:08:52 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:08:52 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:08:52 user nova-compute[72426]:       <entry name="serial">dad9feb1-d5fa-4ed2-9fe3-1573010446f6</entry>
Aug 01 08:08:52 user nova-compute[72426]:       <entry name="uuid">dad9feb1-d5fa-4ed2-9fe3-1573010446f6</entry>
Aug 01 08:08:52 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:08:52 user nova-compute[72426]:     </system>
Aug 01 08:08:52 user nova-compute[72426]:   </sysinfo>
Aug 01 08:08:52 user nova-compute[72426]:   <os>
Aug 01 08:08:52 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:08:52 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:08:52 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:08:52 user nova-compute[72426]:   </os>
Aug 01 08:08:52 user nova-compute[72426]:   <features>
Aug 01 08:08:52 user nova-compute[72426]:     <acpi/>
Aug 01 08:08:52 user nova-compute[72426]:     <apic/>
Aug 01 08:08:52 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:08:52 user nova-compute[72426]:   </features>
Aug 01 08:08:52 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:08:52 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:08:52 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:08:52 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:08:52 user nova-compute[72426]:   </clock>
Aug 01 08:08:52 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:08:52 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:08:52 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:08:52 user nova-compute[72426]:   </cpu>
Aug 01 08:08:52 user nova-compute[72426]:   <devices>
Aug 01 08:08:52 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:08:52 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:08:52 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk"/>
Aug 01 08:08:52 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:08:52 user nova-compute[72426]:     </disk>
Aug 01 08:08:52 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:08:52 user nova-compute[72426]:       <mac address="fa:16:3e:84:24:c8"/>
Aug 01 08:08:52 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:08:52 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:08:52 user nova-compute[72426]:       <target dev="tap197ec10c-39"/>
Aug 01 08:08:52 user nova-compute[72426]:     </interface>
Aug 01 08:08:52 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:08:52 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/console.log" append="off"/>
Aug 01 08:08:52 user nova-compute[72426]:     </serial>
Aug 01 08:08:52 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:08:52 user nova-compute[72426]:     <video>
Aug 01 08:08:52 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:08:52 user nova-compute[72426]:     </video>
Aug 01 08:08:52 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:08:52 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:08:52 user nova-compute[72426]:     </rng>
Aug 01 08:08:52 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:08:52 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:08:52 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:08:52 user nova-compute[72426]:     </memballoon>
Aug 01 08:08:52 user nova-compute[72426]:   </devices>
Aug 01 08:08:52 user nova-compute[72426]: </domain>
Aug 01 08:08:52 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-422374365',display_name='tempest-ServerActionsTestOtherB-server-422374365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-422374365',id=4,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl2oApS4LEi4Ig2bO8yUSo9wl16TwUkqqncZenLkty2XY524bkKbL5wZtWU4/2TUExag9ZWoRoLkyDVuWFoEcjk8zjc/94JyqcQHN/o4NaNjQ0nXMRCRju0bzFZ7w6HLQ==',key_name='tempest-keypair-1006503589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32d0ba9feb9244e88cb3945f553c8ac7',ramdisk_id='',reservation_id='r-zqp59lbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-252722777',owner_user_name='tempest-ServerActionsTestOtherB-252722777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:08:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fec3b4665a148e498a731cfeef7f589',uuid=dad9feb1-d5fa-4ed2-9fe3-1573010446f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converting VIF {"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG os_vif [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap197ec10c-39, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap197ec10c-39, col_values=(('external_ids', {'iface-id': '197ec10c-39a4-4c89-b675-b7bb2ee90b1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:24:c8', 'vm-uuid': 'dad9feb1-d5fa-4ed2-9fe3-1573010446f6'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:52 user nova-compute[72426]: INFO os_vif [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39')
Aug 01 08:08:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:08:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] No VIF found with MAC fa:16:3e:84:24:c8, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:08:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:53 user nova-compute[72426]: DEBUG nova.network.neutron [req-daeb5383-4ac8-4878-a460-56003ea4355e req-bd9c7169-adbe-454e-ad55-5f8ff483d7f1 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updated VIF entry in instance network info cache for port 197ec10c-39a4-4c89-b675-b7bb2ee90b1f. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:08:53 user nova-compute[72426]: DEBUG nova.network.neutron [req-daeb5383-4ac8-4878-a460-56003ea4355e req-bd9c7169-adbe-454e-ad55-5f8ff483d7f1 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance_info_cache with network_info: [{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:08:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-daeb5383-4ac8-4878-a460-56003ea4355e req-bd9c7169-adbe-454e-ad55-5f8ff483d7f1 service nova] Releasing lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:08:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Acquiring lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG nova.compute.manager [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:08:55 user nova-compute[72426]: INFO nova.compute.claims [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Claim successful on node user
Aug 01 08:08:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-c4486110-296b-4671-929d-081b281e2e41 req-5194a8f7-2ab0-42df-8acc-56ee08946cf7 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c4486110-296b-4671-929d-081b281e2e41 req-5194a8f7-2ab0-42df-8acc-56ee08946cf7 service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c4486110-296b-4671-929d-081b281e2e41 req-5194a8f7-2ab0-42df-8acc-56ee08946cf7 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c4486110-296b-4671-929d-081b281e2e41 req-5194a8f7-2ab0-42df-8acc-56ee08946cf7 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-c4486110-296b-4671-929d-081b281e2e41 req-5194a8f7-2ab0-42df-8acc-56ee08946cf7 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:08:55 user nova-compute[72426]: WARNING nova.compute.manager [req-c4486110-296b-4671-929d-081b281e2e41 req-5194a8f7-2ab0-42df-8acc-56ee08946cf7 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state building and task_state spawning.
Aug 01 08:08:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.925s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.network.neutron [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:08:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:08:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Creating image(s)
Aug 01 08:08:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "/opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "/opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877336.9427083, dad9feb1-d5fa-4ed2-9fe3-1573010446f6 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:08:56 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] VM Resumed (Lifecycle Event)
Aug 01 08:08:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance spawned successfully.
Aug 01 08:08:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.202s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.policy [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b5f10cb5e124b6c9ee4a98a94670d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e69adfe29f4af2ab57772c309b7c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:08:57 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877336.9447145, dad9feb1-d5fa-4ed2-9fe3-1573010446f6 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:08:57 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] VM Started (Lifecycle Event)
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:08:57 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.176s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:57 user nova-compute[72426]: INFO nova.compute.manager [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Took 13.59 seconds to spawn the instance on the hypervisor.
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk 1073741824" returned: 0 in 0.056s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:57 user nova-compute[72426]: INFO nova.compute.manager [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Took 14.52 seconds to build instance.
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.205s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9fbb4b0b-cb81-4392-b6cb-b8b78d89416f tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.677s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Cannot resize image /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.objects.instance [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lazy-loading 'migration_context' on Instance uuid 7f0c3f3b-a037-4925-8fff-089cc5c5b759 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Ensure instance console log exists: /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-2ac4683c-90bf-4757-a43a-e22c7c9e305e req-1cd7eff4-a799-4674-87b6-ee8b406283da service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2ac4683c-90bf-4757-a43a-e22c7c9e305e req-1cd7eff4-a799-4674-87b6-ee8b406283da service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2ac4683c-90bf-4757-a43a-e22c7c9e305e req-1cd7eff4-a799-4674-87b6-ee8b406283da service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2ac4683c-90bf-4757-a43a-e22c7c9e305e req-1cd7eff4-a799-4674-87b6-ee8b406283da service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:08:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-2ac4683c-90bf-4757-a43a-e22c7c9e305e req-1cd7eff4-a799-4674-87b6-ee8b406283da service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:08:57 user nova-compute[72426]: WARNING nova.compute.manager [req-2ac4683c-90bf-4757-a43a-e22c7c9e305e req-1cd7eff4-a799-4674-87b6-ee8b406283da service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state active and task_state None.
Aug 01 08:08:58 user nova-compute[72426]: DEBUG nova.network.neutron [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Successfully created port: faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:08:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:08:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:08:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:08:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:08:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:08:59 user nova-compute[72426]: INFO nova.compute.claims [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Claim successful on node user
Aug 01 08:09:00 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:09:00 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:09:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.765s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:09:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:09:00 user nova-compute[72426]: DEBUG nova.network.neutron [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:09:00 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:09:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG nova.policy [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b37a9ddbd9454c0996c1271a13c941d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebec9a843238456ca5d7fdf893326c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG nova.compute.manager [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:09:01 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Creating image(s)
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "/opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "/opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "/opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.227s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG nova.network.neutron [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Successfully updated port: faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-2a22a31b-e109-43fc-95a0-ee5c9aa210b4 req-c698ff89-d738-4dd7-b408-1bf1d19691bf service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Received event network-changed-faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-2a22a31b-e109-43fc-95a0-ee5c9aa210b4 req-c698ff89-d738-4dd7-b408-1bf1d19691bf service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Refreshing instance network info cache due to event network-changed-faa3adeb-3aa5-4f09-9dfe-6c101a39233c. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2a22a31b-e109-43fc-95a0-ee5c9aa210b4 req-c698ff89-d738-4dd7-b408-1bf1d19691bf service nova] Acquiring lock "refresh_cache-7f0c3f3b-a037-4925-8fff-089cc5c5b759" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2a22a31b-e109-43fc-95a0-ee5c9aa210b4 req-c698ff89-d738-4dd7-b408-1bf1d19691bf service nova] Acquired lock "refresh_cache-7f0c3f3b-a037-4925-8fff-089cc5c5b759" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG nova.network.neutron [req-2a22a31b-e109-43fc-95a0-ee5c9aa210b4 req-c698ff89-d738-4dd7-b408-1bf1d19691bf service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Refreshing network info cache for port faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Acquiring lock "refresh_cache-7f0c3f3b-a037-4925-8fff-089cc5c5b759" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.277s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk 1073741824" returned: 0 in 0.067s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:01 user nova-compute[72426]: DEBUG nova.network.neutron [req-2a22a31b-e109-43fc-95a0-ee5c9aa210b4 req-c698ff89-d738-4dd7-b408-1bf1d19691bf service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.183s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Successfully created port: 0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Cannot resize image /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG nova.objects.instance [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lazy-loading 'migration_context' on Instance uuid 457df7dd-4e0f-4d72-915b-644f0c8588eb {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Ensure instance console log exists: /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG nova.compute.manager [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG nova.network.neutron [req-2a22a31b-e109-43fc-95a0-ee5c9aa210b4 req-c698ff89-d738-4dd7-b408-1bf1d19691bf service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2a22a31b-e109-43fc-95a0-ee5c9aa210b4 req-c698ff89-d738-4dd7-b408-1bf1d19691bf service nova] Releasing lock "refresh_cache-7f0c3f3b-a037-4925-8fff-089cc5c5b759" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Acquired lock "refresh_cache-7f0c3f3b-a037-4925-8fff-089cc5c5b759" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:09:02 user nova-compute[72426]: INFO nova.compute.claims [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Claim successful on node user
Aug 01 08:09:03 user nova-compute[72426]: DEBUG nova.network.neutron [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:03 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:09:03 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:09:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.817s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:09:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:09:03 user nova-compute[72426]: DEBUG nova.network.neutron [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:09:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 01 08:09:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.network.neutron [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Successfully updated port: 0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.policy [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60c058782355441c897d7677a79abfa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e658a8f757ae427b98330de9ce86291a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquired lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.network.neutron [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-70b95bab-be61-4db4-9854-b29a9adc5d04 req-a3a5413e-9bf1-42f9-b94d-961966cd3669 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received event network-changed-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-70b95bab-be61-4db4-9854-b29a9adc5d04 req-a3a5413e-9bf1-42f9-b94d-961966cd3669 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Refreshing instance network info cache due to event network-changed-0e7037af-0c00-4388-a819-04af9c0a565c. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-70b95bab-be61-4db4-9854-b29a9adc5d04 req-a3a5413e-9bf1-42f9-b94d-961966cd3669 service nova] Acquiring lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.compute.manager [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:09:04 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Creating image(s)
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "/opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "/opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "/opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "02ba7b5d2f8df2b73c5a94ede242190a79e62aaa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "02ba7b5d2f8df2b73c5a94ede242190a79e62aaa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.network.neutron [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa.part --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.network.neutron [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Updating instance_info_cache with network_info: [{"id": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "address": "fa:16:3e:af:c9:16", "network": {"id": "9876c05a-ab1b-4f00-9617-093cea90fe21", "bridge": "br-int", "label": "tempest-VolumesActionsTest-619969235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e69adfe29f4af2ab57772c309b7c7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa3adeb-3a", "ovs_interfaceid": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Releasing lock "refresh_cache-7f0c3f3b-a037-4925-8fff-089cc5c5b759" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.compute.manager [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Instance network_info: |[{"id": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "address": "fa:16:3e:af:c9:16", "network": {"id": "9876c05a-ab1b-4f00-9617-093cea90fe21", "bridge": "br-int", "label": "tempest-VolumesActionsTest-619969235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e69adfe29f4af2ab57772c309b7c7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa3adeb-3a", "ovs_interfaceid": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Start _get_guest_xml network_info=[{"id": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "address": "fa:16:3e:af:c9:16", "network": {"id": "9876c05a-ab1b-4f00-9617-093cea90fe21", "bridge": "br-int", "label": "tempest-VolumesActionsTest-619969235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e69adfe29f4af2ab57772c309b7c7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa3adeb-3a", "ovs_interfaceid": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa.part --force-share --output=json" returned: 0 in 0.186s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.virt.images [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] 44c8042a-57ee-454c-a5a9-1c5969bcf383 was qcow2, converting to raw {{(pid=72426) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:09:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa.part /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa.converted {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:05 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:05 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1109490873',display_name='tempest-VolumesActionsTest-instance-1109490873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1109490873',id=5,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50e69adfe29f4af2ab57772c309b7c7b',ramdisk_id='',reservation_id='r-45tpqnxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-46354128',owner_user_name='tempest-VolumesActionsTest-46354128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:08:57Z,user_data=None,user_id='1b5f10cb5e124b6c9ee4a98a94670d8c',uuid=7f0c3f3b-a037-4925-8fff-089cc5c5b759,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "address": "fa:16:3e:af:c9:16", "network": {"id": "9876c05a-ab1b-4f00-9617-093cea90fe21", "bridge": "br-int", "label": "tempest-VolumesActionsTest-619969235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e69adfe29f4af2ab57772c309b7c7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa3adeb-3a", "ovs_interfaceid": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Converting VIF {"id": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "address": "fa:16:3e:af:c9:16", "network": {"id": "9876c05a-ab1b-4f00-9617-093cea90fe21", "bridge": "br-int", "label": "tempest-VolumesActionsTest-619969235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e69adfe29f4af2ab57772c309b7c7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa3adeb-3a", "ovs_interfaceid": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=faa3adeb-3aa5-4f09-9dfe-6c101a39233c,network=Network(9876c05a-ab1b-4f00-9617-093cea90fe21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa3adeb-3a') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f0c3f3b-a037-4925-8fff-089cc5c5b759 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:09:05 user nova-compute[72426]:   <uuid>7f0c3f3b-a037-4925-8fff-089cc5c5b759</uuid>
Aug 01 08:09:05 user nova-compute[72426]:   <name>instance-00000005</name>
Aug 01 08:09:05 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:09:05 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:09:05 user nova-compute[72426]:   <metadata>
Aug 01 08:09:05 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:09:05 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:09:05 user nova-compute[72426]:       <nova:name>tempest-VolumesActionsTest-instance-1109490873</nova:name>
Aug 01 08:09:05 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:09:05</nova:creationTime>
Aug 01 08:09:05 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:09:05 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:09:05 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:09:05 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:09:05 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:09:05 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:09:05 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:09:05 user nova-compute[72426]:       <nova:owner>
Aug 01 08:09:05 user nova-compute[72426]:         <nova:user uuid="1b5f10cb5e124b6c9ee4a98a94670d8c">tempest-VolumesActionsTest-46354128-project-member</nova:user>
Aug 01 08:09:05 user nova-compute[72426]:         <nova:project uuid="50e69adfe29f4af2ab57772c309b7c7b">tempest-VolumesActionsTest-46354128</nova:project>
Aug 01 08:09:05 user nova-compute[72426]:       </nova:owner>
Aug 01 08:09:05 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:09:05 user nova-compute[72426]:       <nova:ports>
Aug 01 08:09:05 user nova-compute[72426]:         <nova:port uuid="faa3adeb-3aa5-4f09-9dfe-6c101a39233c">
Aug 01 08:09:05 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 08:09:05 user nova-compute[72426]:         </nova:port>
Aug 01 08:09:05 user nova-compute[72426]:       </nova:ports>
Aug 01 08:09:05 user nova-compute[72426]:     </nova:instance>
Aug 01 08:09:05 user nova-compute[72426]:   </metadata>
Aug 01 08:09:05 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:09:05 user nova-compute[72426]:     <system>
Aug 01 08:09:05 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:09:05 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:09:05 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:09:05 user nova-compute[72426]:       <entry name="serial">7f0c3f3b-a037-4925-8fff-089cc5c5b759</entry>
Aug 01 08:09:05 user nova-compute[72426]:       <entry name="uuid">7f0c3f3b-a037-4925-8fff-089cc5c5b759</entry>
Aug 01 08:09:05 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:09:05 user nova-compute[72426]:     </system>
Aug 01 08:09:05 user nova-compute[72426]:   </sysinfo>
Aug 01 08:09:05 user nova-compute[72426]:   <os>
Aug 01 08:09:05 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:09:05 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:09:05 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:09:05 user nova-compute[72426]:   </os>
Aug 01 08:09:05 user nova-compute[72426]:   <features>
Aug 01 08:09:05 user nova-compute[72426]:     <acpi/>
Aug 01 08:09:05 user nova-compute[72426]:     <apic/>
Aug 01 08:09:05 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:09:05 user nova-compute[72426]:   </features>
Aug 01 08:09:05 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:09:05 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:09:05 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:09:05 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:09:05 user nova-compute[72426]:   </clock>
Aug 01 08:09:05 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:09:05 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:09:05 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:09:05 user nova-compute[72426]:   </cpu>
Aug 01 08:09:05 user nova-compute[72426]:   <devices>
Aug 01 08:09:05 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:09:05 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:09:05 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk"/>
Aug 01 08:09:05 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:09:05 user nova-compute[72426]:     </disk>
Aug 01 08:09:05 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:09:05 user nova-compute[72426]:       <mac address="fa:16:3e:af:c9:16"/>
Aug 01 08:09:05 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:09:05 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:09:05 user nova-compute[72426]:       <target dev="tapfaa3adeb-3a"/>
Aug 01 08:09:05 user nova-compute[72426]:     </interface>
Aug 01 08:09:05 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:09:05 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/console.log" append="off"/>
Aug 01 08:09:05 user nova-compute[72426]:     </serial>
Aug 01 08:09:05 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:09:05 user nova-compute[72426]:     <video>
Aug 01 08:09:05 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:09:05 user nova-compute[72426]:     </video>
Aug 01 08:09:05 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:09:05 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:09:05 user nova-compute[72426]:     </rng>
Aug 01 08:09:05 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:09:05 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:09:05 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:09:05 user nova-compute[72426]:     </memballoon>
Aug 01 08:09:05 user nova-compute[72426]:   </devices>
Aug 01 08:09:05 user nova-compute[72426]: </domain>
Aug 01 08:09:05 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1109490873',display_name='tempest-VolumesActionsTest-instance-1109490873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1109490873',id=5,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50e69adfe29f4af2ab57772c309b7c7b',ramdisk_id='',reservation_id='r-45tpqnxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-46354128',owner_user_name='tempest-VolumesActionsTest-46354128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:08:57Z,user_data=None,user_id='1b5f10cb5e124b6c9ee4a98a94670d8c',uuid=7f0c3f3b-a037-4925-8fff-089cc5c5b759,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "address": "fa:16:3e:af:c9:16", "network": {"id": "9876c05a-ab1b-4f00-9617-093cea90fe21", "bridge": "br-int", "label": "tempest-VolumesActionsTest-619969235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e69adfe29f4af2ab57772c309b7c7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa3adeb-3a", "ovs_interfaceid": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Converting VIF {"id": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "address": "fa:16:3e:af:c9:16", "network": {"id": "9876c05a-ab1b-4f00-9617-093cea90fe21", "bridge": "br-int", "label": "tempest-VolumesActionsTest-619969235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e69adfe29f4af2ab57772c309b7c7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa3adeb-3a", "ovs_interfaceid": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=faa3adeb-3aa5-4f09-9dfe-6c101a39233c,network=Network(9876c05a-ab1b-4f00-9617-093cea90fe21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa3adeb-3a') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG os_vif [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=faa3adeb-3aa5-4f09-9dfe-6c101a39233c,network=Network(9876c05a-ab1b-4f00-9617-093cea90fe21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa3adeb-3a') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfaa3adeb-3a, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfaa3adeb-3a, col_values=(('external_ids', {'iface-id': 'faa3adeb-3aa5-4f09-9dfe-6c101a39233c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:c9:16', 'vm-uuid': '7f0c3f3b-a037-4925-8fff-089cc5c5b759'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:05 user nova-compute[72426]: INFO os_vif [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=faa3adeb-3aa5-4f09-9dfe-6c101a39233c,network=Network(9876c05a-ab1b-4f00-9617-093cea90fe21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa3adeb-3a')
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa.part /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa.converted" returned: 0 in 0.351s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa.converted --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.network.neutron [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Successfully created port: aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] No VIF found with MAC fa:16:3e:af:c9:16, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa.converted --force-share --output=json" returned: 0 in 0.248s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "02ba7b5d2f8df2b73c5a94ede242190a79e62aaa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.393s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.network.neutron [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Updating instance_info_cache with network_info: [{"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa --force-share --output=json" returned: 0 in 0.253s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "02ba7b5d2f8df2b73c5a94ede242190a79e62aaa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "02ba7b5d2f8df2b73c5a94ede242190a79e62aaa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Releasing lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.compute.manager [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Instance network_info: |[{"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-70b95bab-be61-4db4-9854-b29a9adc5d04 req-a3a5413e-9bf1-42f9-b94d-961966cd3669 service nova] Acquired lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.network.neutron [req-70b95bab-be61-4db4-9854-b29a9adc5d04 req-a3a5413e-9bf1-42f9-b94d-961966cd3669 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Refreshing network info cache for port 0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:09:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Start _get_guest_xml network_info=[{"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:09:05 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:06 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa --force-share --output=json" returned: 0 in 0.171s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa,backing_fmt=raw /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-989886833',display_name='tempest-VolumesAdminNegativeTest-server-989886833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-989886833',id=6,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdSLoGwqDXfCm2qME6VlQAsvKozbYJlIeEbiJY6y1/uBXlWpKrRwulLQsl7OV3TH4qRQgkMCsNXjhe3DGSBulcCdKoXkTzLLE7fMITb1gjZCsUB/wORpne6ILnW1dOoCQ==',key_name='tempest-keypair-1370144311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebec9a843238456ca5d7fdf893326c4f',ramdisk_id='',reservation_id='r-4nx78hsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-336374183',owner_user_name='tempest-VolumesAdminNegativeTest-336374183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b37a9ddbd9454c0996c1271a13c941d4',uuid=457df7dd-4e0f-4d72-915b-644f0c8588eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converting VIF {"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:1c:0b,bridge_name='br-int',has_traffic_filtering=True,id=0e7037af-0c00-4388-a819-04af9c0a565c,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7037af-0c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.objects.instance [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lazy-loading 'pci_devices' on Instance uuid 457df7dd-4e0f-4d72-915b-644f0c8588eb {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa,backing_fmt=raw /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk 1073741824" returned: 0 in 0.095s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "02ba7b5d2f8df2b73c5a94ede242190a79e62aaa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:09:06 user nova-compute[72426]:   <uuid>457df7dd-4e0f-4d72-915b-644f0c8588eb</uuid>
Aug 01 08:09:06 user nova-compute[72426]:   <name>instance-00000006</name>
Aug 01 08:09:06 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:09:06 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:09:06 user nova-compute[72426]:   <metadata>
Aug 01 08:09:06 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:09:06 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:09:06 user nova-compute[72426]:       <nova:name>tempest-VolumesAdminNegativeTest-server-989886833</nova:name>
Aug 01 08:09:06 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:09:06</nova:creationTime>
Aug 01 08:09:06 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:09:06 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:09:06 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:09:06 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:09:06 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:09:06 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:09:06 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:09:06 user nova-compute[72426]:       <nova:owner>
Aug 01 08:09:06 user nova-compute[72426]:         <nova:user uuid="b37a9ddbd9454c0996c1271a13c941d4">tempest-VolumesAdminNegativeTest-336374183-project-member</nova:user>
Aug 01 08:09:06 user nova-compute[72426]:         <nova:project uuid="ebec9a843238456ca5d7fdf893326c4f">tempest-VolumesAdminNegativeTest-336374183</nova:project>
Aug 01 08:09:06 user nova-compute[72426]:       </nova:owner>
Aug 01 08:09:06 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:09:06 user nova-compute[72426]:       <nova:ports>
Aug 01 08:09:06 user nova-compute[72426]:         <nova:port uuid="0e7037af-0c00-4388-a819-04af9c0a565c">
Aug 01 08:09:06 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 08:09:06 user nova-compute[72426]:         </nova:port>
Aug 01 08:09:06 user nova-compute[72426]:       </nova:ports>
Aug 01 08:09:06 user nova-compute[72426]:     </nova:instance>
Aug 01 08:09:06 user nova-compute[72426]:   </metadata>
Aug 01 08:09:06 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:09:06 user nova-compute[72426]:     <system>
Aug 01 08:09:06 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:09:06 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:09:06 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:09:06 user nova-compute[72426]:       <entry name="serial">457df7dd-4e0f-4d72-915b-644f0c8588eb</entry>
Aug 01 08:09:06 user nova-compute[72426]:       <entry name="uuid">457df7dd-4e0f-4d72-915b-644f0c8588eb</entry>
Aug 01 08:09:06 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:09:06 user nova-compute[72426]:     </system>
Aug 01 08:09:06 user nova-compute[72426]:   </sysinfo>
Aug 01 08:09:06 user nova-compute[72426]:   <os>
Aug 01 08:09:06 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:09:06 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:09:06 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:09:06 user nova-compute[72426]:   </os>
Aug 01 08:09:06 user nova-compute[72426]:   <features>
Aug 01 08:09:06 user nova-compute[72426]:     <acpi/>
Aug 01 08:09:06 user nova-compute[72426]:     <apic/>
Aug 01 08:09:06 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:09:06 user nova-compute[72426]:   </features>
Aug 01 08:09:06 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:09:06 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:09:06 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:09:06 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:09:06 user nova-compute[72426]:   </clock>
Aug 01 08:09:06 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:09:06 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:09:06 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:09:06 user nova-compute[72426]:   </cpu>
Aug 01 08:09:06 user nova-compute[72426]:   <devices>
Aug 01 08:09:06 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:09:06 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:09:06 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk"/>
Aug 01 08:09:06 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:09:06 user nova-compute[72426]:     </disk>
Aug 01 08:09:06 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:09:06 user nova-compute[72426]:       <mac address="fa:16:3e:db:1c:0b"/>
Aug 01 08:09:06 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:09:06 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:09:06 user nova-compute[72426]:       <target dev="tap0e7037af-0c"/>
Aug 01 08:09:06 user nova-compute[72426]:     </interface>
Aug 01 08:09:06 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:09:06 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/console.log" append="off"/>
Aug 01 08:09:06 user nova-compute[72426]:     </serial>
Aug 01 08:09:06 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:09:06 user nova-compute[72426]:     <video>
Aug 01 08:09:06 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:09:06 user nova-compute[72426]:     </video>
Aug 01 08:09:06 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:09:06 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:09:06 user nova-compute[72426]:     </rng>
Aug 01 08:09:06 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:09:06 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:09:06 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:09:06 user nova-compute[72426]:     </memballoon>
Aug 01 08:09:06 user nova-compute[72426]:   </devices>
Aug 01 08:09:06 user nova-compute[72426]: </domain>
Aug 01 08:09:06 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-989886833',display_name='tempest-VolumesAdminNegativeTest-server-989886833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-989886833',id=6,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdSLoGwqDXfCm2qME6VlQAsvKozbYJlIeEbiJY6y1/uBXlWpKrRwulLQsl7OV3TH4qRQgkMCsNXjhe3DGSBulcCdKoXkTzLLE7fMITb1gjZCsUB/wORpne6ILnW1dOoCQ==',key_name='tempest-keypair-1370144311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebec9a843238456ca5d7fdf893326c4f',ramdisk_id='',reservation_id='r-4nx78hsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-336374183',owner_user_name='tempest-VolumesAdminNegativeTest-336374183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b37a9ddbd9454c0996c1271a13c941d4',uuid=457df7dd-4e0f-4d72-915b-644f0c8588eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converting VIF {"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:1c:0b,bridge_name='br-int',has_traffic_filtering=True,id=0e7037af-0c00-4388-a819-04af9c0a565c,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7037af-0c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG os_vif [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:1c:0b,bridge_name='br-int',has_traffic_filtering=True,id=0e7037af-0c00-4388-a819-04af9c0a565c,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7037af-0c') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e7037af-0c, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e7037af-0c, col_values=(('external_ids', {'iface-id': '0e7037af-0c00-4388-a819-04af9c0a565c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:1c:0b', 'vm-uuid': '457df7dd-4e0f-4d72-915b-644f0c8588eb'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:09:06 user nova-compute[72426]: INFO os_vif [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:1c:0b,bridge_name='br-int',has_traffic_filtering=True,id=0e7037af-0c00-4388-a819-04af9c0a565c,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7037af-0c')
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02ba7b5d2f8df2b73c5a94ede242190a79e62aaa --force-share --output=json" returned: 0 in 0.185s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] No VIF found with MAC fa:16:3e:db:1c:0b, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Cannot resize image /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.objects.instance [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lazy-loading 'migration_context' on Instance uuid ace240ab-fe78-416a-b45a-85d66b8ac8cd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Ensure instance console log exists: /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG nova.network.neutron [req-70b95bab-be61-4db4-9854-b29a9adc5d04 req-a3a5413e-9bf1-42f9-b94d-961966cd3669 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Updated VIF entry in instance network info cache for port 0e7037af-0c00-4388-a819-04af9c0a565c. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG nova.network.neutron [req-70b95bab-be61-4db4-9854-b29a9adc5d04 req-a3a5413e-9bf1-42f9-b94d-961966cd3669 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Updating instance_info_cache with network_info: [{"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-70b95bab-be61-4db4-9854-b29a9adc5d04 req-a3a5413e-9bf1-42f9-b94d-961966cd3669 service nova] Releasing lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG nova.network.neutron [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Successfully updated port: aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "refresh_cache-ace240ab-fe78-416a-b45a-85d66b8ac8cd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquired lock "refresh_cache-ace240ab-fe78-416a-b45a-85d66b8ac8cd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG nova.network.neutron [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-d372a919-4446-4669-9aa2-240b3c9b9efa req-e6e7f749-404f-40ef-af68-aeaaa7e94690 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received event network-changed-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-d372a919-4446-4669-9aa2-240b3c9b9efa req-e6e7f749-404f-40ef-af68-aeaaa7e94690 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Refreshing instance network info cache due to event network-changed-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d372a919-4446-4669-9aa2-240b3c9b9efa req-e6e7f749-404f-40ef-af68-aeaaa7e94690 service nova] Acquiring lock "refresh_cache-ace240ab-fe78-416a-b45a-85d66b8ac8cd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG nova.network.neutron [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-fd40c3a4-db6f-48ce-a462-8b1e3ea11394 req-48ff847e-6de8-45ac-b3b8-c22a72e1c7b2 service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Received event network-vif-plugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fd40c3a4-db6f-48ce-a462-8b1e3ea11394 req-48ff847e-6de8-45ac-b3b8-c22a72e1c7b2 service nova] Acquiring lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fd40c3a4-db6f-48ce-a462-8b1e3ea11394 req-48ff847e-6de8-45ac-b3b8-c22a72e1c7b2 service nova] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fd40c3a4-db6f-48ce-a462-8b1e3ea11394 req-48ff847e-6de8-45ac-b3b8-c22a72e1c7b2 service nova] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-fd40c3a4-db6f-48ce-a462-8b1e3ea11394 req-48ff847e-6de8-45ac-b3b8-c22a72e1c7b2 service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] No waiting events found dispatching network-vif-plugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:09:07 user nova-compute[72426]: WARNING nova.compute.manager [req-fd40c3a4-db6f-48ce-a462-8b1e3ea11394 req-48ff847e-6de8-45ac-b3b8-c22a72e1c7b2 service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Received unexpected event network-vif-plugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c for instance with vm_state building and task_state spawning.
Aug 01 08:09:07 user nova-compute[72426]: DEBUG nova.network.neutron [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Updating instance_info_cache with network_info: [{"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Releasing lock "refresh_cache-ace240ab-fe78-416a-b45a-85d66b8ac8cd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Instance network_info: |[{"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d372a919-4446-4669-9aa2-240b3c9b9efa req-e6e7f749-404f-40ef-af68-aeaaa7e94690 service nova] Acquired lock "refresh_cache-ace240ab-fe78-416a-b45a-85d66b8ac8cd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.network.neutron [req-d372a919-4446-4669-9aa2-240b3c9b9efa req-e6e7f749-404f-40ef-af68-aeaaa7e94690 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Refreshing network info cache for port aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Start _get_guest_xml network_info=[{"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:08:52Z,direct_url=<?>,disk_format='qcow2',id=44c8042a-57ee-454c-a5a9-1c5969bcf383,min_disk=0,min_ram=0,name='',owner='d4f9328ecffb43c18f0b2c7e918cb90e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:08:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'disk_bus': 'scsi', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '44c8042a-57ee-454c-a5a9-1c5969bcf383'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:09:08 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:08 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:08:52Z,direct_url=<?>,disk_format='qcow2',id=44c8042a-57ee-454c-a5a9-1c5969bcf383,min_disk=0,min_ram=0,name='',owner='d4f9328ecffb43c18f0b2c7e918cb90e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:08:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-13021962',display_name='tempest-AttachSCSIVolumeTestJSON-server-13021962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-13021962',id=7,image_ref='44c8042a-57ee-454c-a5a9-1c5969bcf383',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaX1n3rfb0jmRqvPU29SmMdHegN2dCtlvmCVdoUgEv82Mnvh3BDJwB5/4dY0RlHCWCM4i3NBf0hkDWZsD6MqOvVJeFQwtH1WOKdXs6TptgI/cJ53CiF7fqNqvK47KZVTA==',key_name='tempest-keypair-2061250495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e658a8f757ae427b98330de9ce86291a',ramdisk_id='',reservation_id='r-082vhmkb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='44c8042a-57ee-454c-a5a9-1c5969bcf383',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-130105759',owner_user_name='tempest-AttachSCSIVolumeTestJSON-130105759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60c058782355441c897d7677a79abfa1',uuid=ace240ab-fe78-416a-b45a-85d66b8ac8cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Converting VIF {"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:ab,bridge_name='br-int',has_traffic_filtering=True,id=aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4,network=Network(00f4371d-adfc-4a86-ab2b-ea48dcd03258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5f921a-9e') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.objects.instance [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lazy-loading 'pci_devices' on Instance uuid ace240ab-fe78-416a-b45a-85d66b8ac8cd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:09:08 user nova-compute[72426]:   <uuid>ace240ab-fe78-416a-b45a-85d66b8ac8cd</uuid>
Aug 01 08:09:08 user nova-compute[72426]:   <name>instance-00000007</name>
Aug 01 08:09:08 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:09:08 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:09:08 user nova-compute[72426]:   <metadata>
Aug 01 08:09:08 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:09:08 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:09:08 user nova-compute[72426]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-13021962</nova:name>
Aug 01 08:09:08 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:09:08</nova:creationTime>
Aug 01 08:09:08 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:09:08 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:09:08 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:09:08 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:09:08 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:09:08 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:09:08 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:09:08 user nova-compute[72426]:       <nova:owner>
Aug 01 08:09:08 user nova-compute[72426]:         <nova:user uuid="60c058782355441c897d7677a79abfa1">tempest-AttachSCSIVolumeTestJSON-130105759-project-member</nova:user>
Aug 01 08:09:08 user nova-compute[72426]:         <nova:project uuid="e658a8f757ae427b98330de9ce86291a">tempest-AttachSCSIVolumeTestJSON-130105759</nova:project>
Aug 01 08:09:08 user nova-compute[72426]:       </nova:owner>
Aug 01 08:09:08 user nova-compute[72426]:       <nova:root type="image" uuid="44c8042a-57ee-454c-a5a9-1c5969bcf383"/>
Aug 01 08:09:08 user nova-compute[72426]:       <nova:ports>
Aug 01 08:09:08 user nova-compute[72426]:         <nova:port uuid="aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4">
Aug 01 08:09:08 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 08:09:08 user nova-compute[72426]:         </nova:port>
Aug 01 08:09:08 user nova-compute[72426]:       </nova:ports>
Aug 01 08:09:08 user nova-compute[72426]:     </nova:instance>
Aug 01 08:09:08 user nova-compute[72426]:   </metadata>
Aug 01 08:09:08 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:09:08 user nova-compute[72426]:     <system>
Aug 01 08:09:08 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:09:08 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:09:08 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:09:08 user nova-compute[72426]:       <entry name="serial">ace240ab-fe78-416a-b45a-85d66b8ac8cd</entry>
Aug 01 08:09:08 user nova-compute[72426]:       <entry name="uuid">ace240ab-fe78-416a-b45a-85d66b8ac8cd</entry>
Aug 01 08:09:08 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:09:08 user nova-compute[72426]:     </system>
Aug 01 08:09:08 user nova-compute[72426]:   </sysinfo>
Aug 01 08:09:08 user nova-compute[72426]:   <os>
Aug 01 08:09:08 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:09:08 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:09:08 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:09:08 user nova-compute[72426]:   </os>
Aug 01 08:09:08 user nova-compute[72426]:   <features>
Aug 01 08:09:08 user nova-compute[72426]:     <acpi/>
Aug 01 08:09:08 user nova-compute[72426]:     <apic/>
Aug 01 08:09:08 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:09:08 user nova-compute[72426]:   </features>
Aug 01 08:09:08 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:09:08 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:09:08 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:09:08 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:09:08 user nova-compute[72426]:   </clock>
Aug 01 08:09:08 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:09:08 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:09:08 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:09:08 user nova-compute[72426]:   </cpu>
Aug 01 08:09:08 user nova-compute[72426]:   <devices>
Aug 01 08:09:08 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:09:08 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:09:08 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk"/>
Aug 01 08:09:08 user nova-compute[72426]:       <target dev="sda" bus="scsi"/>
Aug 01 08:09:08 user nova-compute[72426]:       <address type="drive" controller="0" unit="0"/>
Aug 01 08:09:08 user nova-compute[72426]:     </disk>
Aug 01 08:09:08 user nova-compute[72426]:     <disk type="file" device="cdrom">
Aug 01 08:09:08 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 08:09:08 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk.config"/>
Aug 01 08:09:08 user nova-compute[72426]:       <target dev="sdb" bus="scsi"/>
Aug 01 08:09:08 user nova-compute[72426]:       <address type="drive" controller="0" unit="1"/>
Aug 01 08:09:08 user nova-compute[72426]:     </disk>
Aug 01 08:09:08 user nova-compute[72426]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 01 08:09:08 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:09:08 user nova-compute[72426]:       <mac address="fa:16:3e:b6:23:ab"/>
Aug 01 08:09:08 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:09:08 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:09:08 user nova-compute[72426]:       <target dev="tapaa5f921a-9e"/>
Aug 01 08:09:08 user nova-compute[72426]:     </interface>
Aug 01 08:09:08 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:09:08 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/console.log" append="off"/>
Aug 01 08:09:08 user nova-compute[72426]:     </serial>
Aug 01 08:09:08 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:09:08 user nova-compute[72426]:     <video>
Aug 01 08:09:08 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:09:08 user nova-compute[72426]:     </video>
Aug 01 08:09:08 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:09:08 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:09:08 user nova-compute[72426]:     </rng>
Aug 01 08:09:08 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:09:08 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:09:08 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:09:08 user nova-compute[72426]:     </memballoon>
Aug 01 08:09:08 user nova-compute[72426]:   </devices>
Aug 01 08:09:08 user nova-compute[72426]: </domain>
Aug 01 08:09:08 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-13021962',display_name='tempest-AttachSCSIVolumeTestJSON-server-13021962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-13021962',id=7,image_ref='44c8042a-57ee-454c-a5a9-1c5969bcf383',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaX1n3rfb0jmRqvPU29SmMdHegN2dCtlvmCVdoUgEv82Mnvh3BDJwB5/4dY0RlHCWCM4i3NBf0hkDWZsD6MqOvVJeFQwtH1WOKdXs6TptgI/cJ53CiF7fqNqvK47KZVTA==',key_name='tempest-keypair-2061250495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e658a8f757ae427b98330de9ce86291a',ramdisk_id='',reservation_id='r-082vhmkb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='44c8042a-57ee-454c-a5a9-1c5969bcf383',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-130105759',owner_user_name='tempest-AttachSCSIVolumeTestJSON-130105759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60c058782355441c897d7677a79abfa1',uuid=ace240ab-fe78-416a-b45a-85d66b8ac8cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Converting VIF {"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:ab,bridge_name='br-int',has_traffic_filtering=True,id=aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4,network=Network(00f4371d-adfc-4a86-ab2b-ea48dcd03258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5f921a-9e') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG os_vif [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:ab,bridge_name='br-int',has_traffic_filtering=True,id=aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4,network=Network(00f4371d-adfc-4a86-ab2b-ea48dcd03258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5f921a-9e') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa5f921a-9e, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa5f921a-9e, col_values=(('external_ids', {'iface-id': 'aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:23:ab', 'vm-uuid': 'ace240ab-fe78-416a-b45a-85d66b8ac8cd'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:08 user nova-compute[72426]: INFO os_vif [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:23:ab,bridge_name='br-int',has_traffic_filtering=True,id=aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4,network=Network(00f4371d-adfc-4a86-ab2b-ea48dcd03258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5f921a-9e')
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] No BDM found with device name sda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] No VIF found with MAC fa:16:3e:b6:23:ab, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:09:08 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Using config drive
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.network.neutron [req-d372a919-4446-4669-9aa2-240b3c9b9efa req-e6e7f749-404f-40ef-af68-aeaaa7e94690 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Updated VIF entry in instance network info cache for port aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG nova.network.neutron [req-d372a919-4446-4669-9aa2-240b3c9b9efa req-e6e7f749-404f-40ef-af68-aeaaa7e94690 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Updating instance_info_cache with network_info: [{"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d372a919-4446-4669-9aa2-240b3c9b9efa req-e6e7f749-404f-40ef-af68-aeaaa7e94690 service nova] Releasing lock "refresh_cache-ace240ab-fe78-416a-b45a-85d66b8ac8cd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:08 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Creating config drive at /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk.config
Aug 01 08:09:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdtxeok99 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdtxeok99" returned: 0 in 0.086s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Received event network-vif-plugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] Acquiring lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] No waiting events found dispatching network-vif-plugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:09:09 user nova-compute[72426]: WARNING nova.compute.manager [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Received unexpected event network-vif-plugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c for instance with vm_state building and task_state spawning.
Aug 01 08:09:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received event network-vif-plugged-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] Acquiring lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] No waiting events found dispatching network-vif-plugged-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:09:09 user nova-compute[72426]: WARNING nova.compute.manager [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received unexpected event network-vif-plugged-0e7037af-0c00-4388-a819-04af9c0a565c for instance with vm_state building and task_state spawning.
Aug 01 08:09:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received event network-vif-plugged-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] Acquiring lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] No waiting events found dispatching network-vif-plugged-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:09:09 user nova-compute[72426]: WARNING nova.compute.manager [req-f4d70c5c-2152-4fce-9ca9-e7957b3cc447 req-c609bf02-0674-4c53-b4be-429f8a84151a service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received unexpected event network-vif-plugged-0e7037af-0c00-4388-a819-04af9c0a565c for instance with vm_state building and task_state spawning.
Aug 01 08:09:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:09:11 user nova-compute[72426]: INFO nova.compute.claims [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Claim successful on node user
Aug 01 08:09:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received event network-vif-plugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] Acquiring lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] No waiting events found dispatching network-vif-plugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:09:11 user nova-compute[72426]: WARNING nova.compute.manager [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received unexpected event network-vif-plugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 for instance with vm_state building and task_state spawning.
Aug 01 08:09:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received event network-vif-plugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] Acquiring lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] No waiting events found dispatching network-vif-plugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:09:11 user nova-compute[72426]: WARNING nova.compute.manager [req-935465a9-e707-439a-acb6-4a2f56a7eedd req-c532f3ca-f569-4005-8fb8-8eac27ea8b19 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received unexpected event network-vif-plugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 for instance with vm_state building and task_state spawning.
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.818s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:09:12 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877352.4008563, 7f0c3f3b-a037-4925-8fff-089cc5c5b759 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:09:12 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] VM Resumed (Lifecycle Event)
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:09:12 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Instance spawned successfully.
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.policy [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e2c0341b2e04acc91fecdce1a6575b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa3149b4b4b4c978f6af96161dadce7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:12 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877352.4030323, 7f0c3f3b-a037-4925-8fff-089cc5c5b759 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:09:12 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] VM Started (Lifecycle Event)
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:09:12 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Creating image(s)
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "/opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "/opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "/opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:12 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:09:12 user nova-compute[72426]: INFO nova.compute.manager [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Took 15.85 seconds to spawn the instance on the hypervisor.
Aug 01 08:09:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:12 user nova-compute[72426]: INFO nova.compute.manager [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Took 17.35 seconds to build instance.
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-42ac55b7-6b54-4b69-9cb1-d4a9958ad53c tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.608s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.165s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk 1073741824" returned: 0 in 0.050s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.211s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877353.1767824, 457df7dd-4e0f-4d72-915b-644f0c8588eb => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] VM Resumed (Lifecycle Event)
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Instance spawned successfully.
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877353.1779103, 457df7dd-4e0f-4d72-915b-644f0c8588eb => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] VM Started (Lifecycle Event)
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Cannot resize image /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lazy-loading 'migration_context' on Instance uuid f826ffe7-92dc-4f05-9298-1236513a1af2 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Ensure instance console log exists: /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Took 12.14 seconds to spawn the instance on the hypervisor.
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Successfully created port: b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877353.5091107, ace240ab-fe78-416a-b45a-85d66b8ac8cd => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] VM Resumed (Lifecycle Event)
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Took 13.65 seconds to build instance.
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Instance spawned successfully.
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-043c97d6-b923-4329-ad10-e679be78f23a tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.884s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877353.519177, ace240ab-fe78-416a-b45a-85d66b8ac8cd => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] VM Started (Lifecycle Event)
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:09:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Took 9.66 seconds to spawn the instance on the hypervisor.
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:09:13 user nova-compute[72426]: INFO nova.compute.manager [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Took 11.06 seconds to build instance.
Aug 01 08:09:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-32909930-3dc5-4db0-a4c8-5c4b9a5d9ddc tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.544s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:09:14 user nova-compute[72426]: INFO nova.compute.claims [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Claim successful on node user
Aug 01 08:09:14 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.819s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Successfully updated port: b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquired lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG nova.network.neutron [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-d8c37815-05c6-4775-b456-41a567b08927 req-7a6f2952-2054-443d-8d44-c99ae02931d9 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received event network-changed-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-d8c37815-05c6-4775-b456-41a567b08927 req-7a6f2952-2054-443d-8d44-c99ae02931d9 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Refreshing instance network info cache due to event network-changed-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:09:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d8c37815-05c6-4775-b456-41a567b08927 req-7a6f2952-2054-443d-8d44-c99ae02931d9 service nova] Acquiring lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:09:15 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Creating image(s)
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.policy [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '641e3764d33b496ca438a15c878f9be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454252382eb548feadc6ea9d263ced60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.166s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk 1073741824" returned: 0 in 0.067s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Updating instance_info_cache with network_info: [{"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Releasing lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Instance network_info: |[{"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d8c37815-05c6-4775-b456-41a567b08927 req-7a6f2952-2054-443d-8d44-c99ae02931d9 service nova] Acquired lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.network.neutron [req-d8c37815-05c6-4775-b456-41a567b08927 req-7a6f2952-2054-443d-8d44-c99ae02931d9 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Refreshing network info cache for port b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Start _get_guest_xml network_info=[{"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:09:15 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:15 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-227999925',display_name='tempest-TestVolumeSwap-server-227999925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-227999925',id=8,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjeJVzeeno6AmMMX0kdxdclc9K/mX7j7fsOWkX1M8Nic78znnbGcL+WjNGXmm6IlwowlFy7ZkI9+lBlMe5i6qbKi8Wwrx5tHfVxNdEnjN1qBS7TbMy3psRG6x1D5A/3LQ==',key_name='tempest-keypair-1928294829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa3149b4b4b4c978f6af96161dadce7',ramdisk_id='',reservation_id='r-9fl951p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-669238879',owner_user_name='tempest-TestVolumeSwap-669238879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e2c0341b2e04acc91fecdce1a6575b1',uuid=f826ffe7-92dc-4f05-9298-1236513a1af2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Converting VIF {"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2d:40,bridge_name='br-int',has_traffic_filtering=True,id=b624f3e1-a1cb-4147-89de-7f2bf45ac4c8,network=Network(9adff86d-4f28-46e5-94c5-1efe0cf0ab5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624f3e1-a1') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lazy-loading 'pci_devices' on Instance uuid f826ffe7-92dc-4f05-9298-1236513a1af2 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.186s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:09:15 user nova-compute[72426]:   <uuid>f826ffe7-92dc-4f05-9298-1236513a1af2</uuid>
Aug 01 08:09:15 user nova-compute[72426]:   <name>instance-00000008</name>
Aug 01 08:09:15 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:09:15 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:09:15 user nova-compute[72426]:   <metadata>
Aug 01 08:09:15 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:09:15 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:09:15 user nova-compute[72426]:       <nova:name>tempest-TestVolumeSwap-server-227999925</nova:name>
Aug 01 08:09:15 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:09:15</nova:creationTime>
Aug 01 08:09:15 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:09:15 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:09:15 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:09:15 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:09:15 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:09:15 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:09:15 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:09:15 user nova-compute[72426]:       <nova:owner>
Aug 01 08:09:15 user nova-compute[72426]:         <nova:user uuid="1e2c0341b2e04acc91fecdce1a6575b1">tempest-TestVolumeSwap-669238879-project-member</nova:user>
Aug 01 08:09:15 user nova-compute[72426]:         <nova:project uuid="faa3149b4b4b4c978f6af96161dadce7">tempest-TestVolumeSwap-669238879</nova:project>
Aug 01 08:09:15 user nova-compute[72426]:       </nova:owner>
Aug 01 08:09:15 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:09:15 user nova-compute[72426]:       <nova:ports>
Aug 01 08:09:15 user nova-compute[72426]:         <nova:port uuid="b624f3e1-a1cb-4147-89de-7f2bf45ac4c8">
Aug 01 08:09:15 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 08:09:15 user nova-compute[72426]:         </nova:port>
Aug 01 08:09:15 user nova-compute[72426]:       </nova:ports>
Aug 01 08:09:15 user nova-compute[72426]:     </nova:instance>
Aug 01 08:09:15 user nova-compute[72426]:   </metadata>
Aug 01 08:09:15 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:09:15 user nova-compute[72426]:     <system>
Aug 01 08:09:15 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:09:15 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:09:15 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:09:15 user nova-compute[72426]:       <entry name="serial">f826ffe7-92dc-4f05-9298-1236513a1af2</entry>
Aug 01 08:09:15 user nova-compute[72426]:       <entry name="uuid">f826ffe7-92dc-4f05-9298-1236513a1af2</entry>
Aug 01 08:09:15 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:09:15 user nova-compute[72426]:     </system>
Aug 01 08:09:15 user nova-compute[72426]:   </sysinfo>
Aug 01 08:09:15 user nova-compute[72426]:   <os>
Aug 01 08:09:15 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:09:15 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:09:15 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:09:15 user nova-compute[72426]:   </os>
Aug 01 08:09:15 user nova-compute[72426]:   <features>
Aug 01 08:09:15 user nova-compute[72426]:     <acpi/>
Aug 01 08:09:15 user nova-compute[72426]:     <apic/>
Aug 01 08:09:15 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:09:15 user nova-compute[72426]:   </features>
Aug 01 08:09:15 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:09:15 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:09:15 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:09:15 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:09:15 user nova-compute[72426]:   </clock>
Aug 01 08:09:15 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:09:15 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:09:15 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:09:15 user nova-compute[72426]:   </cpu>
Aug 01 08:09:15 user nova-compute[72426]:   <devices>
Aug 01 08:09:15 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:09:15 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:09:15 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk"/>
Aug 01 08:09:15 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:09:15 user nova-compute[72426]:     </disk>
Aug 01 08:09:15 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:09:15 user nova-compute[72426]:       <mac address="fa:16:3e:c4:2d:40"/>
Aug 01 08:09:15 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:09:15 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:09:15 user nova-compute[72426]:       <target dev="tapb624f3e1-a1"/>
Aug 01 08:09:15 user nova-compute[72426]:     </interface>
Aug 01 08:09:15 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:09:15 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/console.log" append="off"/>
Aug 01 08:09:15 user nova-compute[72426]:     </serial>
Aug 01 08:09:15 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:09:15 user nova-compute[72426]:     <video>
Aug 01 08:09:15 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:09:15 user nova-compute[72426]:     </video>
Aug 01 08:09:15 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:09:15 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:09:15 user nova-compute[72426]:     </rng>
Aug 01 08:09:15 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:09:15 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:09:15 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:09:15 user nova-compute[72426]:     </memballoon>
Aug 01 08:09:15 user nova-compute[72426]:   </devices>
Aug 01 08:09:15 user nova-compute[72426]: </domain>
Aug 01 08:09:15 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-227999925',display_name='tempest-TestVolumeSwap-server-227999925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-227999925',id=8,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjeJVzeeno6AmMMX0kdxdclc9K/mX7j7fsOWkX1M8Nic78znnbGcL+WjNGXmm6IlwowlFy7ZkI9+lBlMe5i6qbKi8Wwrx5tHfVxNdEnjN1qBS7TbMy3psRG6x1D5A/3LQ==',key_name='tempest-keypair-1928294829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa3149b4b4b4c978f6af96161dadce7',ramdisk_id='',reservation_id='r-9fl951p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-669238879',owner_user_name='tempest-TestVolumeSwap-669238879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e2c0341b2e04acc91fecdce1a6575b1',uuid=f826ffe7-92dc-4f05-9298-1236513a1af2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Converting VIF {"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2d:40,bridge_name='br-int',has_traffic_filtering=True,id=b624f3e1-a1cb-4147-89de-7f2bf45ac4c8,network=Network(9adff86d-4f28-46e5-94c5-1efe0cf0ab5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624f3e1-a1') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG os_vif [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2d:40,bridge_name='br-int',has_traffic_filtering=True,id=b624f3e1-a1cb-4147-89de-7f2bf45ac4c8,network=Network(9adff86d-4f28-46e5-94c5-1efe0cf0ab5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624f3e1-a1') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb624f3e1-a1, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb624f3e1-a1, col_values=(('external_ids', {'iface-id': 'b624f3e1-a1cb-4147-89de-7f2bf45ac4c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:2d:40', 'vm-uuid': 'f826ffe7-92dc-4f05-9298-1236513a1af2'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:09:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:15 user nova-compute[72426]: INFO os_vif [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:2d:40,bridge_name='br-int',has_traffic_filtering=True,id=b624f3e1-a1cb-4147-89de-7f2bf45ac4c8,network=Network(9adff86d-4f28-46e5-94c5-1efe0cf0ab5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624f3e1-a1')
Aug 01 08:09:16 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Cannot resize image /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG nova.objects.instance [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lazy-loading 'migration_context' on Instance uuid 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Ensure instance console log exists: /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] No VIF found with MAC fa:16:3e:c4:2d:40, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG nova.network.neutron [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Successfully created port: 7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG nova.network.neutron [req-d8c37815-05c6-4775-b456-41a567b08927 req-7a6f2952-2054-443d-8d44-c99ae02931d9 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Updated VIF entry in instance network info cache for port b624f3e1-a1cb-4147-89de-7f2bf45ac4c8. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG nova.network.neutron [req-d8c37815-05c6-4775-b456-41a567b08927 req-7a6f2952-2054-443d-8d44-c99ae02931d9 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Updating instance_info_cache with network_info: [{"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d8c37815-05c6-4775-b456-41a567b08927 req-7a6f2952-2054-443d-8d44-c99ae02931d9 service nova] Releasing lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG nova.network.neutron [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Successfully updated port: 7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquired lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG nova.network.neutron [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] There are 0 instances to clean {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72426) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG nova.compute.manager [req-0db10ec9-92b8-4a89-9591-25186c4cfec5 req-3a55b9d7-3e4d-421d-a25f-fbc48e084db3 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-changed-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG nova.compute.manager [req-0db10ec9-92b8-4a89-9591-25186c4cfec5 req-3a55b9d7-3e4d-421d-a25f-fbc48e084db3 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Refreshing instance network info cache due to event network-changed-7525e311-6c46-4621-94e5-96940d9e88bd. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0db10ec9-92b8-4a89-9591-25186c4cfec5 req-3a55b9d7-3e4d-421d-a25f-fbc48e084db3 service nova] Acquiring lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG nova.network.neutron [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.network.neutron [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updating instance_info_cache with network_info: [{"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Releasing lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Instance network_info: |[{"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0db10ec9-92b8-4a89-9591-25186c4cfec5 req-3a55b9d7-3e4d-421d-a25f-fbc48e084db3 service nova] Acquired lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.network.neutron [req-0db10ec9-92b8-4a89-9591-25186c4cfec5 req-3a55b9d7-3e4d-421d-a25f-fbc48e084db3 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Refreshing network info cache for port 7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Start _get_guest_xml network_info=[{"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:09:18 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:18 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455569858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455569858',id=9,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUTKnKkZhlWKyb1LXTXXMdqlOlZZJdmZ9D32CohZpgmKqsMway4Q46JX9kgFrLWSVxlSTmjjnXKE3nj8JkoaJvwMhj80lrL96T/qO9KIMTBN0WYaPWA4D1/DHkKIHvFhg==',key_name='tempest-keypair-215514464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='454252382eb548feadc6ea9d263ced60',ramdisk_id='',reservation_id='r-3s80pq9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-725575124',owner_user_name='tempest-TaggedAttachmentsTest-725575124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='641e3764d33b496ca438a15c878f9be2',uuid=9c26ba65-f5a0-499b-9891-c84e1530f40f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converting VIF {"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:d4:1c,bridge_name='br-int',has_traffic_filtering=True,id=7525e311-6c46-4621-94e5-96940d9e88bd,network=Network(2b502c96-9201-4be8-83a4-28c70a20299c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525e311-6c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.objects.instance [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-40841e73-4c30-4f80-987c-c18116a88329 req-757b7d3d-9d18-4204-9547-b941b811bb78 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received event network-vif-plugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-40841e73-4c30-4f80-987c-c18116a88329 req-757b7d3d-9d18-4204-9547-b941b811bb78 service nova] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-40841e73-4c30-4f80-987c-c18116a88329 req-757b7d3d-9d18-4204-9547-b941b811bb78 service nova] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-40841e73-4c30-4f80-987c-c18116a88329 req-757b7d3d-9d18-4204-9547-b941b811bb78 service nova] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-40841e73-4c30-4f80-987c-c18116a88329 req-757b7d3d-9d18-4204-9547-b941b811bb78 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] No waiting events found dispatching network-vif-plugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:09:18 user nova-compute[72426]: WARNING nova.compute.manager [req-40841e73-4c30-4f80-987c-c18116a88329 req-757b7d3d-9d18-4204-9547-b941b811bb78 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received unexpected event network-vif-plugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 for instance with vm_state building and task_state spawning.
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:09:18 user nova-compute[72426]:   <uuid>9c26ba65-f5a0-499b-9891-c84e1530f40f</uuid>
Aug 01 08:09:18 user nova-compute[72426]:   <name>instance-00000009</name>
Aug 01 08:09:18 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:09:18 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:09:18 user nova-compute[72426]:   <metadata>
Aug 01 08:09:18 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:09:18 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:09:18 user nova-compute[72426]:       <nova:name>tempest-device-tagging-server-1455569858</nova:name>
Aug 01 08:09:18 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:09:18</nova:creationTime>
Aug 01 08:09:18 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:09:18 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:09:18 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:09:18 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:09:18 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:09:18 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:09:18 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:09:18 user nova-compute[72426]:       <nova:owner>
Aug 01 08:09:18 user nova-compute[72426]:         <nova:user uuid="641e3764d33b496ca438a15c878f9be2">tempest-TaggedAttachmentsTest-725575124-project-member</nova:user>
Aug 01 08:09:18 user nova-compute[72426]:         <nova:project uuid="454252382eb548feadc6ea9d263ced60">tempest-TaggedAttachmentsTest-725575124</nova:project>
Aug 01 08:09:18 user nova-compute[72426]:       </nova:owner>
Aug 01 08:09:18 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:09:18 user nova-compute[72426]:       <nova:ports>
Aug 01 08:09:18 user nova-compute[72426]:         <nova:port uuid="7525e311-6c46-4621-94e5-96940d9e88bd">
Aug 01 08:09:18 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 08:09:18 user nova-compute[72426]:         </nova:port>
Aug 01 08:09:18 user nova-compute[72426]:       </nova:ports>
Aug 01 08:09:18 user nova-compute[72426]:     </nova:instance>
Aug 01 08:09:18 user nova-compute[72426]:   </metadata>
Aug 01 08:09:18 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:09:18 user nova-compute[72426]:     <system>
Aug 01 08:09:18 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:09:18 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:09:18 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:09:18 user nova-compute[72426]:       <entry name="serial">9c26ba65-f5a0-499b-9891-c84e1530f40f</entry>
Aug 01 08:09:18 user nova-compute[72426]:       <entry name="uuid">9c26ba65-f5a0-499b-9891-c84e1530f40f</entry>
Aug 01 08:09:18 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:09:18 user nova-compute[72426]:     </system>
Aug 01 08:09:18 user nova-compute[72426]:   </sysinfo>
Aug 01 08:09:18 user nova-compute[72426]:   <os>
Aug 01 08:09:18 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:09:18 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:09:18 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:09:18 user nova-compute[72426]:   </os>
Aug 01 08:09:18 user nova-compute[72426]:   <features>
Aug 01 08:09:18 user nova-compute[72426]:     <acpi/>
Aug 01 08:09:18 user nova-compute[72426]:     <apic/>
Aug 01 08:09:18 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:09:18 user nova-compute[72426]:   </features>
Aug 01 08:09:18 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:09:18 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:09:18 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:09:18 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:09:18 user nova-compute[72426]:   </clock>
Aug 01 08:09:18 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:09:18 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:09:18 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:09:18 user nova-compute[72426]:   </cpu>
Aug 01 08:09:18 user nova-compute[72426]:   <devices>
Aug 01 08:09:18 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:09:18 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:09:18 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk"/>
Aug 01 08:09:18 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:09:18 user nova-compute[72426]:     </disk>
Aug 01 08:09:18 user nova-compute[72426]:     <disk type="file" device="cdrom">
Aug 01 08:09:18 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 08:09:18 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk.config"/>
Aug 01 08:09:18 user nova-compute[72426]:       <target dev="hda" bus="ide"/>
Aug 01 08:09:18 user nova-compute[72426]:     </disk>
Aug 01 08:09:18 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:09:18 user nova-compute[72426]:       <mac address="fa:16:3e:7e:d4:1c"/>
Aug 01 08:09:18 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:09:18 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:09:18 user nova-compute[72426]:       <target dev="tap7525e311-6c"/>
Aug 01 08:09:18 user nova-compute[72426]:     </interface>
Aug 01 08:09:18 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:09:18 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/console.log" append="off"/>
Aug 01 08:09:18 user nova-compute[72426]:     </serial>
Aug 01 08:09:18 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:09:18 user nova-compute[72426]:     <video>
Aug 01 08:09:18 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:09:18 user nova-compute[72426]:     </video>
Aug 01 08:09:18 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:09:18 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:09:18 user nova-compute[72426]:     </rng>
Aug 01 08:09:18 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:09:18 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:09:18 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:09:18 user nova-compute[72426]:     </memballoon>
Aug 01 08:09:18 user nova-compute[72426]:   </devices>
Aug 01 08:09:18 user nova-compute[72426]: </domain>
Aug 01 08:09:18 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455569858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455569858',id=9,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUTKnKkZhlWKyb1LXTXXMdqlOlZZJdmZ9D32CohZpgmKqsMway4Q46JX9kgFrLWSVxlSTmjjnXKE3nj8JkoaJvwMhj80lrL96T/qO9KIMTBN0WYaPWA4D1/DHkKIHvFhg==',key_name='tempest-keypair-215514464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='454252382eb548feadc6ea9d263ced60',ramdisk_id='',reservation_id='r-3s80pq9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-725575124',owner_user_name='tempest-TaggedAttachmentsTest-725575124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='641e3764d33b496ca438a15c878f9be2',uuid=9c26ba65-f5a0-499b-9891-c84e1530f40f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converting VIF {"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:d4:1c,bridge_name='br-int',has_traffic_filtering=True,id=7525e311-6c46-4621-94e5-96940d9e88bd,network=Network(2b502c96-9201-4be8-83a4-28c70a20299c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525e311-6c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG os_vif [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:d4:1c,bridge_name='br-int',has_traffic_filtering=True,id=7525e311-6c46-4621-94e5-96940d9e88bd,network=Network(2b502c96-9201-4be8-83a4-28c70a20299c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525e311-6c') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7525e311-6c, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7525e311-6c, col_values=(('external_ids', {'iface-id': '7525e311-6c46-4621-94e5-96940d9e88bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:d4:1c', 'vm-uuid': '9c26ba65-f5a0-499b-9891-c84e1530f40f'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:18 user nova-compute[72426]: INFO os_vif [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:d4:1c,bridge_name='br-int',has_traffic_filtering=True,id=7525e311-6c46-4621-94e5-96940d9e88bd,network=Network(2b502c96-9201-4be8-83a4-28c70a20299c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525e311-6c')
Aug 01 08:09:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] No BDM found with device name hda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] No VIF found with MAC fa:16:3e:7e:d4:1c, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:09:18 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Using config drive
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:18 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Creating config drive at /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk.config
Aug 01 08:09:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp73wfwwho {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp73wfwwho" returned: 0 in 0.072s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:19 user nova-compute[72426]: DEBUG nova.network.neutron [req-0db10ec9-92b8-4a89-9591-25186c4cfec5 req-3a55b9d7-3e4d-421d-a25f-fbc48e084db3 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updated VIF entry in instance network info cache for port 7525e311-6c46-4621-94e5-96940d9e88bd. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:09:19 user nova-compute[72426]: DEBUG nova.network.neutron [req-0db10ec9-92b8-4a89-9591-25186c4cfec5 req-3a55b9d7-3e4d-421d-a25f-fbc48e084db3 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updating instance_info_cache with network_info: [{"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0db10ec9-92b8-4a89-9591-25186c4cfec5 req-3a55b9d7-3e4d-421d-a25f-fbc48e084db3 service nova] Releasing lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-01fe19bc-7168-4683-93a4-40da44029ff9 req-1158d605-aff2-4396-8d7e-324d94812364 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received event network-vif-plugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-01fe19bc-7168-4683-93a4-40da44029ff9 req-1158d605-aff2-4396-8d7e-324d94812364 service nova] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-01fe19bc-7168-4683-93a4-40da44029ff9 req-1158d605-aff2-4396-8d7e-324d94812364 service nova] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-01fe19bc-7168-4683-93a4-40da44029ff9 req-1158d605-aff2-4396-8d7e-324d94812364 service nova] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-01fe19bc-7168-4683-93a4-40da44029ff9 req-1158d605-aff2-4396-8d7e-324d94812364 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] No waiting events found dispatching network-vif-plugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:09:20 user nova-compute[72426]: WARNING nova.compute.manager [req-01fe19bc-7168-4683-93a4-40da44029ff9 req-1158d605-aff2-4396-8d7e-324d94812364 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received unexpected event network-vif-plugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 for instance with vm_state building and task_state spawning.
Aug 01 08:09:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877360.8552656, f826ffe7-92dc-4f05-9298-1236513a1af2 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:09:20 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] VM Resumed (Lifecycle Event)
Aug 01 08:09:20 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Instance spawned successfully.
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:20 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:09:20 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877360.8556452, f826ffe7-92dc-4f05-9298-1236513a1af2 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:09:20 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] VM Started (Lifecycle Event)
Aug 01 08:09:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:09:21 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:09:21 user nova-compute[72426]: INFO nova.compute.manager [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Took 8.59 seconds to spawn the instance on the hypervisor.
Aug 01 08:09:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-d61b4c1a-e73a-4332-9e29-699ece30eefd req-e5ebbb82-0700-4273-9c13-f4a7b384850f service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-plugged-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d61b4c1a-e73a-4332-9e29-699ece30eefd req-e5ebbb82-0700-4273-9c13-f4a7b384850f service nova] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d61b4c1a-e73a-4332-9e29-699ece30eefd req-e5ebbb82-0700-4273-9c13-f4a7b384850f service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d61b4c1a-e73a-4332-9e29-699ece30eefd req-e5ebbb82-0700-4273-9c13-f4a7b384850f service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-d61b4c1a-e73a-4332-9e29-699ece30eefd req-e5ebbb82-0700-4273-9c13-f4a7b384850f service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] No waiting events found dispatching network-vif-plugged-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:09:21 user nova-compute[72426]: WARNING nova.compute.manager [req-d61b4c1a-e73a-4332-9e29-699ece30eefd req-e5ebbb82-0700-4273-9c13-f4a7b384850f service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received unexpected event network-vif-plugged-7525e311-6c46-4621-94e5-96940d9e88bd for instance with vm_state building and task_state spawning.
Aug 01 08:09:21 user nova-compute[72426]: INFO nova.compute.manager [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Took 10.08 seconds to build instance.
Aug 01 08:09:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f781ee7a-9e63-4a49-b903-673c88255607 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.253s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-9bc595ad-9e7b-414e-9d8a-a671d2cf26b2 req-db800c34-bdd1-423e-806b-9d80f0e35a21 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-plugged-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9bc595ad-9e7b-414e-9d8a-a671d2cf26b2 req-db800c34-bdd1-423e-806b-9d80f0e35a21 service nova] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9bc595ad-9e7b-414e-9d8a-a671d2cf26b2 req-db800c34-bdd1-423e-806b-9d80f0e35a21 service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9bc595ad-9e7b-414e-9d8a-a671d2cf26b2 req-db800c34-bdd1-423e-806b-9d80f0e35a21 service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-9bc595ad-9e7b-414e-9d8a-a671d2cf26b2 req-db800c34-bdd1-423e-806b-9d80f0e35a21 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] No waiting events found dispatching network-vif-plugged-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:09:23 user nova-compute[72426]: WARNING nova.compute.manager [req-9bc595ad-9e7b-414e-9d8a-a671d2cf26b2 req-db800c34-bdd1-423e-806b-9d80f0e35a21 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received unexpected event network-vif-plugged-7525e311-6c46-4621-94e5-96940d9e88bd for instance with vm_state building and task_state spawning.
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877363.7830281, 9c26ba65-f5a0-499b-9891-c84e1530f40f => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:09:23 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] VM Resumed (Lifecycle Event)
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:09:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Instance spawned successfully.
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:09:23 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877363.7837236, 9c26ba65-f5a0-499b-9891-c84e1530f40f => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:09:23 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] VM Started (Lifecycle Event)
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:24 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:09:24 user nova-compute[72426]: INFO nova.compute.manager [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Took 8.82 seconds to spawn the instance on the hypervisor.
Aug 01 08:09:24 user nova-compute[72426]: DEBUG nova.compute.manager [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:09:24 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:24 user nova-compute[72426]: INFO nova.compute.manager [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Took 10.31 seconds to build instance.
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-18c48f66-2835-426f-891d-560f1b49e924 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.492s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:25 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:25 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7727MB free_disk=25.95565414428711GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 7f0c3f3b-a037-4925-8fff-089cc5c5b759 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 457df7dd-4e0f-4d72-915b-644f0c8588eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance ace240ab-fe78-416a-b45a-85d66b8ac8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance f826ffe7-92dc-4f05-9298-1236513a1af2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 9c26ba65-f5a0-499b-9891-c84e1530f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:09:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:09:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:26 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:09:26 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:09:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:09:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.034s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:09:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:09:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:28 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:09:28 user nova-compute[72426]: DEBUG nova.objects.instance [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lazy-loading 'info_cache' on Instance uuid 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:09:29 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Updating instance_info_cache with network_info: [{"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:09:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:09:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:09:49 user nova-compute[72426]: INFO nova.compute.claims [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Claim successful on node user
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Refreshing inventories for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Updating ProviderTree inventory for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Updating inventory in ProviderTree for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Refreshing aggregate associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, aggregates: None {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Refreshing trait associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, traits: COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:09:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:09:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:09:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:09:50 user nova-compute[72426]: INFO nova.virt.block_device [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Booting with volume 0d4b24ad-740c-4e2d-9da1-8d15fbbef907 at /dev/vda
Aug 01 08:09:50 user nova-compute[72426]: DEBUG nova.policy [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0770de0d6a7249dc8f22f4e2b7e9200f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ccf58ada6a420999e1003d91124e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:09:50 user nova-compute[72426]: DEBUG os_brick.utils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:09:50 user nova-compute[72426]: INFO oslo.privsep.daemon [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpcihnjx99/privsep.sock']
Aug 01 08:09:50 user sudo[83439]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpcihnjx99/privsep.sock
Aug 01 08:09:50 user sudo[83439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 08:09:50 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully created port: 481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully created port: f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:51 user sudo[83439]: pam_unix(sudo:session): session closed for user root
Aug 01 08:09:51 user nova-compute[72426]: INFO oslo.privsep.daemon [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Spawned new privsep daemon via rootwrap
Aug 01 08:09:51 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 08:09:51 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 08:09:51 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 01 08:09:51 user nova-compute[72426]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83442
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb4f62d-758c-4864-a262-695ef7b8df04]: (2,) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaee711-2e29-4799-b836-22d723ac5af1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:09:51 user nova-compute[72426]: WARNING os_brick.initiator.connectors.nvmeof [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e8d33b-4166-45be-8f33-233e96db3182]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[56707a01-2d8c-4e15-bb0a-e33f664390b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a6f9cc-9537-4bc4-b241-fdac93c4408e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully created port: 40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:09:51 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:09:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b93b6d-f55f-472f-aa5e-25c72c0d84d7]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG os_brick.utils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] <== get_connector_properties: return (1829ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:09:51 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating existing volume attachment record: a1296e41-5d96-4227-ab51-294a4c88ed45 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:09:52 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully created port: 04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:09:53 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully created port: d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:09:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:53 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully updated port: 481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-7f90e91a-95e6-4eea-803f-c29ea0a60a8b req-9e54adb9-013e-4ec9-b6d3-81c77bf21e47 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-changed-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-7f90e91a-95e6-4eea-803f-c29ea0a60a8b req-9e54adb9-013e-4ec9-b6d3-81c77bf21e47 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing instance network info cache due to event network-changed-481af75c-b92e-4885-b57e-9dc756127867. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:09:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7f90e91a-95e6-4eea-803f-c29ea0a60a8b req-9e54adb9-013e-4ec9-b6d3-81c77bf21e47 service nova] Acquiring lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7f90e91a-95e6-4eea-803f-c29ea0a60a8b req-9e54adb9-013e-4ec9-b6d3-81c77bf21e47 service nova] Acquired lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:53 user nova-compute[72426]: DEBUG nova.network.neutron [req-7f90e91a-95e6-4eea-803f-c29ea0a60a8b req-9e54adb9-013e-4ec9-b6d3-81c77bf21e47 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing network info cache for port 481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:09:53 user nova-compute[72426]: DEBUG nova.network.neutron [req-7f90e91a-95e6-4eea-803f-c29ea0a60a8b req-9e54adb9-013e-4ec9-b6d3-81c77bf21e47 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:54 user nova-compute[72426]: DEBUG nova.network.neutron [req-7f90e91a-95e6-4eea-803f-c29ea0a60a8b req-9e54adb9-013e-4ec9-b6d3-81c77bf21e47 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7f90e91a-95e6-4eea-803f-c29ea0a60a8b req-9e54adb9-013e-4ec9-b6d3-81c77bf21e47 service nova] Releasing lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:54 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully updated port: e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:55 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully updated port: 437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-changed-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing instance network info cache due to event network-changed-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:09:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] Acquiring lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] Acquired lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:55 user nova-compute[72426]: DEBUG nova.network.neutron [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing network info cache for port e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG nova.network.neutron [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG nova.network.neutron [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] Releasing lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-changed-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing instance network info cache due to event network-changed-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] Acquiring lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] Acquired lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG nova.network.neutron [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing network info cache for port 437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG nova.network.neutron [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG nova.network.neutron [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-68078b11-aef6-46e8-8f48-ac9e5c730ca9 req-b9d313e3-e494-4aef-972e-cad575612122 service nova] Releasing lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:56 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully updated port: f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:57 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully updated port: 40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-changed-f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing instance network info cache due to event network-changed-f1dab44c-5c92-4f06-b33a-01ccb747256c. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:09:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] Acquiring lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] Acquired lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:57 user nova-compute[72426]: DEBUG nova.network.neutron [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing network info cache for port f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:09:58 user nova-compute[72426]: DEBUG nova.network.neutron [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:58 user nova-compute[72426]: DEBUG nova.network.neutron [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] Releasing lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-changed-40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:09:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing instance network info cache due to event network-changed-40abf17e-0530-4dd1-90d8-df3fb4646463. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:09:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] Acquiring lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:09:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] Acquired lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:09:58 user nova-compute[72426]: DEBUG nova.network.neutron [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing network info cache for port 40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:09:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:09:58 user nova-compute[72426]: DEBUG nova.network.neutron [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG nova.network.neutron [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-faa8d26b-403d-442c-b906-6a50923638ea req-f08b6e13-92a3-4f1b-ba68-c25185e17a05 service nova] Releasing lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully updated port: 04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:09:59 user nova-compute[72426]: INFO nova.virt.block_device [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Booting with volume dbc0f185-6af2-4533-ab53-47580617140c at /dev/vdb
Aug 01 08:09:59 user nova-compute[72426]: DEBUG os_brick.utils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b87b90-824e-4ab0-851c-cd1931452864]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f182ad-06e1-4f71-a47c-375a0dbe253a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e483b8-9050-474e-9309-8dcccc40d176]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f87fef-d9ce-432e-8926-c4d066a83a17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:09:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:00 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:10:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30c22b9-9baf-4fd6-9944-4aed6c5b54d1]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG os_brick.utils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating existing volume attachment record: ae2856ff-b5d0-4b8e-a6c9-a67b1a303a29 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG nova.compute.manager [req-a1032f6d-2d28-4117-ae32-235342b1ad6f req-acabf9a3-1792-4d89-8392-96b4b9cfe74c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-changed-04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG nova.compute.manager [req-a1032f6d-2d28-4117-ae32-235342b1ad6f req-acabf9a3-1792-4d89-8392-96b4b9cfe74c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing instance network info cache due to event network-changed-04b5431f-7fcd-48af-9690-9bdd459dfef9. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a1032f6d-2d28-4117-ae32-235342b1ad6f req-acabf9a3-1792-4d89-8392-96b4b9cfe74c service nova] Acquiring lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a1032f6d-2d28-4117-ae32-235342b1ad6f req-acabf9a3-1792-4d89-8392-96b4b9cfe74c service nova] Acquired lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG nova.network.neutron [req-a1032f6d-2d28-4117-ae32-235342b1ad6f req-acabf9a3-1792-4d89-8392-96b4b9cfe74c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing network info cache for port 04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG nova.network.neutron [req-a1032f6d-2d28-4117-ae32-235342b1ad6f req-acabf9a3-1792-4d89-8392-96b4b9cfe74c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Successfully updated port: d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG nova.network.neutron [req-a1032f6d-2d28-4117-ae32-235342b1ad6f req-acabf9a3-1792-4d89-8392-96b4b9cfe74c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a1032f6d-2d28-4117-ae32-235342b1ad6f req-acabf9a3-1792-4d89-8392-96b4b9cfe74c service nova] Releasing lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquired lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:10:00 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:10:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-ea9ece7f-2e4d-49ed-9b6b-df6e3a88791e req-83c0e9b9-626e-4b88-a6d8-27e059fc3823 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-changed-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-ea9ece7f-2e4d-49ed-9b6b-df6e3a88791e req-83c0e9b9-626e-4b88-a6d8-27e059fc3823 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing instance network info cache due to event network-changed-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:10:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ea9ece7f-2e4d-49ed-9b6b-df6e3a88791e req-83c0e9b9-626e-4b88-a6d8-27e059fc3823 service nova] Acquiring lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:10:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [{"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Releasing lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:10:02 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance network_info: |[{"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:10:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ea9ece7f-2e4d-49ed-9b6b-df6e3a88791e req-83c0e9b9-626e-4b88-a6d8-27e059fc3823 service nova] Acquired lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:10:02 user nova-compute[72426]: DEBUG nova.network.neutron [req-ea9ece7f-2e4d-49ed-9b6b-df6e3a88791e req-83c0e9b9-626e-4b88-a6d8-27e059fc3823 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing network info cache for port d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:10:03 user nova-compute[72426]: DEBUG nova.network.neutron [req-ea9ece7f-2e4d-49ed-9b6b-df6e3a88791e req-83c0e9b9-626e-4b88-a6d8-27e059fc3823 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updated VIF entry in instance network info cache for port d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:10:03 user nova-compute[72426]: DEBUG nova.network.neutron [req-ea9ece7f-2e4d-49ed-9b6b-df6e3a88791e req-83c0e9b9-626e-4b88-a6d8-27e059fc3823 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [{"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ea9ece7f-2e4d-49ed-9b6b-df6e3a88791e req-83c0e9b9-626e-4b88-a6d8-27e059fc3823 service nova] Releasing lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:10:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:07 user nova-compute[72426]: INFO nova.virt.block_device [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Booting with volume 0ba568c3-39ad-43a6-ab2e-986fb844c58f at /dev/vdc
Aug 01 08:10:07 user nova-compute[72426]: DEBUG os_brick.utils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[83615ebc-22c6-44ed-aa24-f74368c02412]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9885fafa-c6a9-4645-99e4-63b8ea839019]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7ce5fa-8a92-4003-82e7-efdcef53a56a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e46fdf-9d5d-41e5-9c80-78d2d95a6470]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:07 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:10:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b91a84-803d-4be9-999a-5ac2a7fcb4cf]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG os_brick.utils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:07 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating existing volume attachment record: 30cb0484-28cf-49e7-aaf9-5aa1c27acfe6 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:10:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:10:17 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Creating image(s)
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Ensure instance console log exists: /opt/stack/data/nova/instances/aae9f4f0-aeda-4008-aaf7-0bc42fa24be4/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Start _get_guest_xml network_info=[{"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvolCaQR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aae9f4f0-aeda-4008-aaf7-0bc42fa24be4', 'attached_at': '', 'detached_at': '', 'volume_id': '0d4b24ad-740c-4e2d-9da1-8d15fbbef907', 'serial': '0d4b24ad-740c-4e2d-9da1-8d15fbbef907'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'a1296e41-5d96-4227-ab51-294a4c88ed45', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuxGnwOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aae9f4f0-aeda-4008-aaf7-0bc42fa24be4', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbc0f185-6af2-4533-ab53-47580617140c', 'serial': 'dbc0f185-6af2-4533-ab53-47580617140c'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'ae2856ff-b5d0-4b8e-a6c9-a67b1a303a29', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kolSNUAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aae9f4f0-aeda-4008-aaf7-0bc42fa24be4', 'attached_at': '', 'detached_at': '', 'volume_id': '0ba568c3-39ad-43a6-ab2e-986fb844c58f', 'serial': '0ba568c3-39ad-43a6-ab2e-986fb844c58f'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '30cb0484-28cf-49e7-aaf9-5aa1c27acfe6', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:10:17 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:10:17 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connector [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Factory for ISCSI on None {{(pid=72426) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvolCaQR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:17 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:17 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:17 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3595bee-8b69-4d62-8565-03da4bc19f9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:10:17 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b04057a-af25-4b5b-b5af-c2bbbb961a9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907] added
Aug 01 08:10:17 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.063s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cac462f-c1c8-4fa3-a037-4957bf8e27d5]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c334107-564c-4554-81ee-07beb22c05a6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvolCaQR {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvolCaQR" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8af6734-da16-4a90-bd54-d20f1df36ee1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvolCaQR'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3261d11d-7b2e-415c-9a5e-d67a0d5fcd87]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b506ed-8f60-49c6-9e0c-843f6c21d8b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:10:17 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:10:17 user nova-compute[72426]:  {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:17 user nova-compute[72426]: WARNING os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 08:10:17 user nova-compute[72426]: 
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[21beda9d-f6bc-44f9-a421-a7f69e3cf763]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907, portal: 172.16.0.220,3260]
Aug 01 08:10:17 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907, portal: 172.16.0.220,3260] successful.
Aug 01 08:10:17 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[962f4cce-5530-4aa7-9d48-37dbc701b38f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdd3ada-3706-457f-881c-73f7abf43d6b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:17 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:17 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[067dbea3-548f-448c-a91c-ce56f0c000c7]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:10:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvolCaQR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23963613866303136', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963613866303136', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuxGnwOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:18 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:18 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:18 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d773dca-cb72-425a-b0b9-cfa6888b9bff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:10:18 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b72a494-3997-479e-8c86-7eb52a5763ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c] added
Aug 01 08:10:18 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[af970661-4324-4c05-8d4e-d7f7fe29235a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0c3587-7852-4cf8-a11b-876b44913c00]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuxGnwOm {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuxGnwOm" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd3cb88-0018-4ec8-af2b-dc7b81d9add9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuxGnwOm'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[39060184-e734-4439-82ff-7175b8396838]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[054db7cb-2f26-4825-a2e3-5dacd00d1ffe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:18 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:18 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a83c8f-c37e-472e-b172-37e834e413d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c, portal: 172.16.0.220,3260]
Aug 01 08:10:19 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c, portal: 172.16.0.220,3260] successful.
Aug 01 08:10:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2544d8-7d88-4eed-9069-415a82f0cc62]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[722e699a-ae08-44d4-b917-2ebc9d85a6d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:19 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:19 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c852c3-d0ab-4e9b-b0e8-d74eddfd0e75]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuxGnwOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23366306665386262', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366306665386262', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kolSNUAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:20 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:20 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:20 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa797d-2e2d-4c64-8c3c-ff8673372e58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:10:20 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdda2f26-bb1d-4d29-9376-966a6eef9a62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f] added
Aug 01 08:10:20 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e218eae4-91b6-457c-a4dd-cb89c5441640]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5b8b2f-b79b-413a-bf7c-447c45789f27]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kolSNUAF {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kolSNUAF" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3d42c3-6ad3-4b06-94ee-e04a7f26484b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kolSNUAF'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[108bd00c-0abe-46e9-90c1-b9547d93ebd6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[646ebe5c-6b89-4719-a511-ed97df67008c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:20 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:20 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:20 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:20 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf5089c-198a-4722-9f71-d42c17497181]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f, portal: 172.16.0.220,3260]
Aug 01 08:10:20 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f, portal: 172.16.0.220,3260] successful.
Aug 01 08:10:20 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[272cc5e3-6326-475e-ad91-2060abc5c692]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfafa8d-f980-49c2-837c-543f1eb0b453]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:20 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:20 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:20 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:20 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:20 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:20 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a607ab-ead2-42be-a606-17de6ef581f4]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:10:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kolSNUAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26332333663663663', 'path': '/dev/sdd'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332333663663663', 'path': '/dev/sdd'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:9b:91,bridge_name='br-int',has_traffic_filtering=True,id=481af75c-b92e-4885-b57e-9dc756127867,network=Network(fab236b7-7894-4166-bca9-03c43dece154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481af75c-b9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:98,bridge_name='br-int',has_traffic_filtering=True,id=e3b61ce5-3f14-497d-ab4c-f8c8bff866a4,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b61ce5-3f') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:22:b4,bridge_name='br-int',has_traffic_filtering=True,id=437ed3bd-d3a0-4d08-8f63-9abbb79f09c0,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437ed3bd-d3') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9b:87,bridge_name='br-int',has_traffic_filtering=True,id=f1dab44c-5c92-4f06-b33a-01ccb747256c,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dab44c-5c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:f4:10,bridge_name='br-int',has_traffic_filtering=True,id=40abf17e-0530-4dd1-90d8-df3fb4646463,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40abf17e-05') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:75:ed,bridge_name='br-int',has_traffic_filtering=True,id=04b5431f-7fcd-48af-9690-9bdd459dfef9,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5431f-7f') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c7:e1,bridge_name='br-int',has_traffic_filtering=True,id=d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a94cb5-b9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.objects.instance [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lazy-loading 'pci_devices' on Instance uuid aae9f4f0-aeda-4008-aaf7-0bc42fa24be4 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:10:21 user nova-compute[72426]:   <uuid>aae9f4f0-aeda-4008-aaf7-0bc42fa24be4</uuid>
Aug 01 08:10:21 user nova-compute[72426]:   <name>instance-0000000a</name>
Aug 01 08:10:21 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:10:21 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:10:21 user nova-compute[72426]:   <metadata>
Aug 01 08:10:21 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:10:21 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:10:21 user nova-compute[72426]:       <nova:name>tempest-device-tagging-server-1455822249</nova:name>
Aug 01 08:10:21 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:10:17</nova:creationTime>
Aug 01 08:10:21 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:10:21 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:10:21 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:10:21 user nova-compute[72426]:       <nova:owner>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:user uuid="0770de0d6a7249dc8f22f4e2b7e9200f">tempest-TaggedBootDevicesTest-828628340-project-member</nova:user>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:project uuid="95ccf58ada6a420999e1003d91124e6c">tempest-TaggedBootDevicesTest-828628340</nova:project>
Aug 01 08:10:21 user nova-compute[72426]:       </nova:owner>
Aug 01 08:10:21 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:10:21 user nova-compute[72426]:       <nova:ports>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:port uuid="481af75c-b92e-4885-b57e-9dc756127867">
Aug 01 08:10:21 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 08:10:21 user nova-compute[72426]:         </nova:port>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:port uuid="e3b61ce5-3f14-497d-ab4c-f8c8bff866a4">
Aug 01 08:10:21 user nova-compute[72426]:           <nova:ip type="fixed" address="10.1.1.39" ipVersion="4"/>
Aug 01 08:10:21 user nova-compute[72426]:         </nova:port>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:port uuid="437ed3bd-d3a0-4d08-8f63-9abbb79f09c0">
Aug 01 08:10:21 user nova-compute[72426]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Aug 01 08:10:21 user nova-compute[72426]:         </nova:port>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:port uuid="f1dab44c-5c92-4f06-b33a-01ccb747256c">
Aug 01 08:10:21 user nova-compute[72426]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Aug 01 08:10:21 user nova-compute[72426]:         </nova:port>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:port uuid="40abf17e-0530-4dd1-90d8-df3fb4646463">
Aug 01 08:10:21 user nova-compute[72426]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
Aug 01 08:10:21 user nova-compute[72426]:         </nova:port>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:port uuid="04b5431f-7fcd-48af-9690-9bdd459dfef9">
Aug 01 08:10:21 user nova-compute[72426]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 08:10:21 user nova-compute[72426]:         </nova:port>
Aug 01 08:10:21 user nova-compute[72426]:         <nova:port uuid="d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5">
Aug 01 08:10:21 user nova-compute[72426]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 08:10:21 user nova-compute[72426]:         </nova:port>
Aug 01 08:10:21 user nova-compute[72426]:       </nova:ports>
Aug 01 08:10:21 user nova-compute[72426]:     </nova:instance>
Aug 01 08:10:21 user nova-compute[72426]:   </metadata>
Aug 01 08:10:21 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:10:21 user nova-compute[72426]:     <system>
Aug 01 08:10:21 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:10:21 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:10:21 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:10:21 user nova-compute[72426]:       <entry name="serial">aae9f4f0-aeda-4008-aaf7-0bc42fa24be4</entry>
Aug 01 08:10:21 user nova-compute[72426]:       <entry name="uuid">aae9f4f0-aeda-4008-aaf7-0bc42fa24be4</entry>
Aug 01 08:10:21 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:10:21 user nova-compute[72426]:     </system>
Aug 01 08:10:21 user nova-compute[72426]:   </sysinfo>
Aug 01 08:10:21 user nova-compute[72426]:   <os>
Aug 01 08:10:21 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:10:21 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:10:21 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:10:21 user nova-compute[72426]:   </os>
Aug 01 08:10:21 user nova-compute[72426]:   <features>
Aug 01 08:10:21 user nova-compute[72426]:     <acpi/>
Aug 01 08:10:21 user nova-compute[72426]:     <apic/>
Aug 01 08:10:21 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:10:21 user nova-compute[72426]:   </features>
Aug 01 08:10:21 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:10:21 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:10:21 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:10:21 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:10:21 user nova-compute[72426]:   </clock>
Aug 01 08:10:21 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:10:21 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:10:21 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:10:21 user nova-compute[72426]:   </cpu>
Aug 01 08:10:21 user nova-compute[72426]:   <devices>
Aug 01 08:10:21 user nova-compute[72426]:     <disk type="file" device="cdrom">
Aug 01 08:10:21 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 08:10:21 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/aae9f4f0-aeda-4008-aaf7-0bc42fa24be4/disk.config"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="hda" bus="ide"/>
Aug 01 08:10:21 user nova-compute[72426]:     </disk>
Aug 01 08:10:21 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:10:21 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:10:21 user nova-compute[72426]:       <source dev="/dev/sdb"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:       <serial>0d4b24ad-740c-4e2d-9da1-8d15fbbef907</serial>
Aug 01 08:10:21 user nova-compute[72426]:     </disk>
Aug 01 08:10:21 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:10:21 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:10:21 user nova-compute[72426]:       <source dev="/dev/sdc"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:       <serial>dbc0f185-6af2-4533-ab53-47580617140c</serial>
Aug 01 08:10:21 user nova-compute[72426]:     </disk>
Aug 01 08:10:21 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:10:21 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:10:21 user nova-compute[72426]:       <source dev="/dev/sdd"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="vdc" bus="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:       <serial>0ba568c3-39ad-43a6-ab2e-986fb844c58f</serial>
Aug 01 08:10:21 user nova-compute[72426]:     </disk>
Aug 01 08:10:21 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:10:21 user nova-compute[72426]:       <mac address="fa:16:3e:df:9b:91"/>
Aug 01 08:10:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="tap481af75c-b9"/>
Aug 01 08:10:21 user nova-compute[72426]:     </interface>
Aug 01 08:10:21 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:10:21 user nova-compute[72426]:       <mac address="fa:16:3e:55:a5:98"/>
Aug 01 08:10:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="tape3b61ce5-3f"/>
Aug 01 08:10:21 user nova-compute[72426]:     </interface>
Aug 01 08:10:21 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:10:21 user nova-compute[72426]:       <mac address="fa:16:3e:52:22:b4"/>
Aug 01 08:10:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="tap437ed3bd-d3"/>
Aug 01 08:10:21 user nova-compute[72426]:     </interface>
Aug 01 08:10:21 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:10:21 user nova-compute[72426]:       <mac address="fa:16:3e:1b:9b:87"/>
Aug 01 08:10:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="tapf1dab44c-5c"/>
Aug 01 08:10:21 user nova-compute[72426]:     </interface>
Aug 01 08:10:21 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:10:21 user nova-compute[72426]:       <mac address="fa:16:3e:71:f4:10"/>
Aug 01 08:10:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="tap40abf17e-05"/>
Aug 01 08:10:21 user nova-compute[72426]:     </interface>
Aug 01 08:10:21 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:10:21 user nova-compute[72426]:       <mac address="fa:16:3e:28:75:ed"/>
Aug 01 08:10:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="tap04b5431f-7f"/>
Aug 01 08:10:21 user nova-compute[72426]:     </interface>
Aug 01 08:10:21 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:10:21 user nova-compute[72426]:       <mac address="fa:16:3e:41:c7:e1"/>
Aug 01 08:10:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:10:21 user nova-compute[72426]:       <target dev="tapd2a94cb5-b9"/>
Aug 01 08:10:21 user nova-compute[72426]:     </interface>
Aug 01 08:10:21 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:10:21 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/aae9f4f0-aeda-4008-aaf7-0bc42fa24be4/console.log" append="off"/>
Aug 01 08:10:21 user nova-compute[72426]:     </serial>
Aug 01 08:10:21 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:10:21 user nova-compute[72426]:     <video>
Aug 01 08:10:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:10:21 user nova-compute[72426]:     </video>
Aug 01 08:10:21 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:10:21 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:10:21 user nova-compute[72426]:     </rng>
Aug 01 08:10:21 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:10:21 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:10:21 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:10:21 user nova-compute[72426]:     </memballoon>
Aug 01 08:10:21 user nova-compute[72426]:   </devices>
Aug 01 08:10:21 user nova-compute[72426]: </domain>
Aug 01 08:10:21 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:9b:91,bridge_name='br-int',has_traffic_filtering=True,id=481af75c-b92e-4885-b57e-9dc756127867,network=Network(fab236b7-7894-4166-bca9-03c43dece154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481af75c-b9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:9b:91,bridge_name='br-int',has_traffic_filtering=True,id=481af75c-b92e-4885-b57e-9dc756127867,network=Network(fab236b7-7894-4166-bca9-03c43dece154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481af75c-b9') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap481af75c-b9, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap481af75c-b9, col_values=(('external_ids', {'iface-id': '481af75c-b92e-4885-b57e-9dc756127867', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:9b:91', 'vm-uuid': 'aae9f4f0-aeda-4008-aaf7-0bc42fa24be4'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: INFO os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:9b:91,bridge_name='br-int',has_traffic_filtering=True,id=481af75c-b92e-4885-b57e-9dc756127867,network=Network(fab236b7-7894-4166-bca9-03c43dece154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481af75c-b9')
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:98,bridge_name='br-int',has_traffic_filtering=True,id=e3b61ce5-3f14-497d-ab4c-f8c8bff866a4,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b61ce5-3f') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:98,bridge_name='br-int',has_traffic_filtering=True,id=e3b61ce5-3f14-497d-ab4c-f8c8bff866a4,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b61ce5-3f') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3b61ce5-3f, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3b61ce5-3f, col_values=(('external_ids', {'iface-id': 'e3b61ce5-3f14-497d-ab4c-f8c8bff866a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:a5:98', 'vm-uuid': 'aae9f4f0-aeda-4008-aaf7-0bc42fa24be4'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: INFO os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:98,bridge_name='br-int',has_traffic_filtering=True,id=e3b61ce5-3f14-497d-ab4c-f8c8bff866a4,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b61ce5-3f')
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:22:b4,bridge_name='br-int',has_traffic_filtering=True,id=437ed3bd-d3a0-4d08-8f63-9abbb79f09c0,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437ed3bd-d3') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:22:b4,bridge_name='br-int',has_traffic_filtering=True,id=437ed3bd-d3a0-4d08-8f63-9abbb79f09c0,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437ed3bd-d3') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap437ed3bd-d3, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap437ed3bd-d3, col_values=(('external_ids', {'iface-id': '437ed3bd-d3a0-4d08-8f63-9abbb79f09c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:22:b4', 'vm-uuid': 'aae9f4f0-aeda-4008-aaf7-0bc42fa24be4'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: INFO os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:22:b4,bridge_name='br-int',has_traffic_filtering=True,id=437ed3bd-d3a0-4d08-8f63-9abbb79f09c0,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437ed3bd-d3')
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9b:87,bridge_name='br-int',has_traffic_filtering=True,id=f1dab44c-5c92-4f06-b33a-01ccb747256c,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dab44c-5c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9b:87,bridge_name='br-int',has_traffic_filtering=True,id=f1dab44c-5c92-4f06-b33a-01ccb747256c,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dab44c-5c') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1dab44c-5c, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1dab44c-5c, col_values=(('external_ids', {'iface-id': 'f1dab44c-5c92-4f06-b33a-01ccb747256c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:9b:87', 'vm-uuid': 'aae9f4f0-aeda-4008-aaf7-0bc42fa24be4'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: INFO os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9b:87,bridge_name='br-int',has_traffic_filtering=True,id=f1dab44c-5c92-4f06-b33a-01ccb747256c,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dab44c-5c')
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:f4:10,bridge_name='br-int',has_traffic_filtering=True,id=40abf17e-0530-4dd1-90d8-df3fb4646463,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40abf17e-05') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:f4:10,bridge_name='br-int',has_traffic_filtering=True,id=40abf17e-0530-4dd1-90d8-df3fb4646463,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40abf17e-05') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40abf17e-05, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40abf17e-05, col_values=(('external_ids', {'iface-id': '40abf17e-0530-4dd1-90d8-df3fb4646463', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:f4:10', 'vm-uuid': 'aae9f4f0-aeda-4008-aaf7-0bc42fa24be4'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: INFO os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:f4:10,bridge_name='br-int',has_traffic_filtering=True,id=40abf17e-0530-4dd1-90d8-df3fb4646463,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40abf17e-05')
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:75:ed,bridge_name='br-int',has_traffic_filtering=True,id=04b5431f-7fcd-48af-9690-9bdd459dfef9,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5431f-7f') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:75:ed,bridge_name='br-int',has_traffic_filtering=True,id=04b5431f-7fcd-48af-9690-9bdd459dfef9,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5431f-7f') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04b5431f-7f, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04b5431f-7f, col_values=(('external_ids', {'iface-id': '04b5431f-7fcd-48af-9690-9bdd459dfef9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:75:ed', 'vm-uuid': 'aae9f4f0-aeda-4008-aaf7-0bc42fa24be4'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: INFO os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:75:ed,bridge_name='br-int',has_traffic_filtering=True,id=04b5431f-7fcd-48af-9690-9bdd459dfef9,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5431f-7f')
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c7:e1,bridge_name='br-int',has_traffic_filtering=True,id=d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a94cb5-b9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c7:e1,bridge_name='br-int',has_traffic_filtering=True,id=d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a94cb5-b9') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2a94cb5-b9, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2a94cb5-b9, col_values=(('external_ids', {'iface-id': 'd2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:c7:e1', 'vm-uuid': 'aae9f4f0-aeda-4008-aaf7-0bc42fa24be4'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:21 user nova-compute[72426]: INFO os_vif [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c7:e1,bridge_name='br-int',has_traffic_filtering=True,id=d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a94cb5-b9')
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] No BDM found with device name hda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] No VIF found with MAC fa:16:3e:df:9b:91, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] No VIF found with MAC fa:16:3e:71:f4:10, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:10:22 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Using config drive
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:22 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Creating config drive at /opt/stack/data/nova/instances/aae9f4f0-aeda-4008-aaf7-0bc42fa24be4/disk.config
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aae9f4f0-aeda-4008-aaf7-0bc42fa24be4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpni_l_lx7 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aae9f4f0-aeda-4008-aaf7-0bc42fa24be4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpni_l_lx7" returned: 0 in 0.077s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lazy-loading 'flavor' on Instance uuid 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.136s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-d3833876-a084-4228-8e38-1bb205fdfe83 req-cb121aa0-4552-49fb-8d28-9193b0542019 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d3833876-a084-4228-8e38-1bb205fdfe83 req-cb121aa0-4552-49fb-8d28-9193b0542019 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d3833876-a084-4228-8e38-1bb205fdfe83 req-cb121aa0-4552-49fb-8d28-9193b0542019 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d3833876-a084-4228-8e38-1bb205fdfe83 req-cb121aa0-4552-49fb-8d28-9193b0542019 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-d3833876-a084-4228-8e38-1bb205fdfe83 req-cb121aa0-4552-49fb-8d28-9193b0542019 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:23 user nova-compute[72426]: WARNING nova.compute.manager [req-d3833876-a084-4228-8e38-1bb205fdfe83 req-cb121aa0-4552-49fb-8d28-9193b0542019 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-481af75c-b92e-4885-b57e-9dc756127867 for instance with vm_state building and task_state spawning.
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:24 user nova-compute[72426]: INFO nova.compute.manager [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Attaching volume 1d5654c0-3da9-4e3f-9512-9d21b2d4f551 to /dev/vdb
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG os_brick.utils [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a723d089-4064-4fef-a503-00434b41ff69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5b9de-9712-4566-9a1c-7fa35b2c812e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92adf0d-5e83-4b7d-90d4-16821a289677]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c811e0e-3328-4c2d-a9ee-625a26eec62d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:24 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cda82cf-b3f1-43e3-a456-a1edd6e1c881]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG os_brick.utils [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Updating existing volume attachment record: da78f7b1-4d11-4b94-9ab3-7c36d98b9b5f {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877427.976567, aae9f4f0-aeda-4008-aaf7-0bc42fa24be4 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:10:28 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] VM Resumed (Lifecycle Event)
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-dace8778-a2d4-4caa-a97d-7693a22bc202 req-f2f99744-1561-4c39-a9de-59b32eb41192 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dace8778-a2d4-4caa-a97d-7693a22bc202 req-f2f99744-1561-4c39-a9de-59b32eb41192 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dace8778-a2d4-4caa-a97d-7693a22bc202 req-f2f99744-1561-4c39-a9de-59b32eb41192 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dace8778-a2d4-4caa-a97d-7693a22bc202 req-f2f99744-1561-4c39-a9de-59b32eb41192 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-dace8778-a2d4-4caa-a97d-7693a22bc202 req-f2f99744-1561-4c39-a9de-59b32eb41192 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-dace8778-a2d4-4caa-a97d-7693a22bc202 req-f2f99744-1561-4c39-a9de-59b32eb41192 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-481af75c-b92e-4885-b57e-9dc756127867 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-f1dab44c-5c92-4f06-b33a-01ccb747256c for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-f1dab44c-5c92-4f06-b33a-01ccb747256c for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-40abf17e-0530-4dd1-90d8-df3fb4646463 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-adb2e596-6846-43de-90c7-c5da5e360bfe req-66b2c3a7-df65-4a4c-be20-2e4eec25af10 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-40abf17e-0530-4dd1-90d8-df3fb4646463 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-c803ad2b-3c24-4bba-a0c0-1a1461a36e3f req-90f3874b-824f-4889-8b34-dc91d4e9b642 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c803ad2b-3c24-4bba-a0c0-1a1461a36e3f req-90f3874b-824f-4889-8b34-dc91d4e9b642 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c803ad2b-3c24-4bba-a0c0-1a1461a36e3f req-90f3874b-824f-4889-8b34-dc91d4e9b642 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c803ad2b-3c24-4bba-a0c0-1a1461a36e3f req-90f3874b-824f-4889-8b34-dc91d4e9b642 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-c803ad2b-3c24-4bba-a0c0-1a1461a36e3f req-90f3874b-824f-4889-8b34-dc91d4e9b642 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-c803ad2b-3c24-4bba-a0c0-1a1461a36e3f req-90f3874b-824f-4889-8b34-dc91d4e9b642 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-6fe4465b-ed2e-49f6-8839-3da67799fbcf req-f18079dc-bebc-439f-8a60-7d4189ed1405 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ff03eba-ea85-4969-abde-1144e3f3e5ff req-beac9177-a43b-4c3b-999c-6ba9e6a647b0 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-changed-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ff03eba-ea85-4969-abde-1144e3f3e5ff req-beac9177-a43b-4c3b-999c-6ba9e6a647b0 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Refreshing instance network info cache due to event network-changed-883a5e52-3445-4ce9-aebd-8a5c59e18e63. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ff03eba-ea85-4969-abde-1144e3f3e5ff req-beac9177-a43b-4c3b-999c-6ba9e6a647b0 service nova] Acquiring lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ff03eba-ea85-4969-abde-1144e3f3e5ff req-beac9177-a43b-4c3b-999c-6ba9e6a647b0 service nova] Acquired lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.network.neutron [req-8ff03eba-ea85-4969-abde-1144e3f3e5ff req-beac9177-a43b-4c3b-999c-6ba9e6a647b0 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Refreshing network info cache for port 883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-35dd9074-03df-4267-bf99-8cee76f902c7 req-45f90e49-4fa9-421c-a04e-eb128d96a3a2 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-35dd9074-03df-4267-bf99-8cee76f902c7 req-45f90e49-4fa9-421c-a04e-eb128d96a3a2 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-35dd9074-03df-4267-bf99-8cee76f902c7 req-45f90e49-4fa9-421c-a04e-eb128d96a3a2 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-35dd9074-03df-4267-bf99-8cee76f902c7 req-45f90e49-4fa9-421c-a04e-eb128d96a3a2 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-35dd9074-03df-4267-bf99-8cee76f902c7 req-45f90e49-4fa9-421c-a04e-eb128d96a3a2 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.compute.manager [req-35dd9074-03df-4267-bf99-8cee76f902c7 req-45f90e49-4fa9-421c-a04e-eb128d96a3a2 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 for instance with vm_state building and task_state spawning.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:10:28 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance spawned successfully.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:10:28 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7038MB free_disk=25.829330444335938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:28 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877427.9779317, aae9f4f0-aeda-4008-aaf7-0bc42fa24be4 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:10:28 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] VM Started (Lifecycle Event)
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:10:28 user nova-compute[72426]: INFO nova.compute.manager [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Took 11.14 seconds to spawn the instance on the hypervisor.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 7f0c3f3b-a037-4925-8fff-089cc5c5b759 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 457df7dd-4e0f-4d72-915b-644f0c8588eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance ace240ab-fe78-416a-b45a-85d66b8ac8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance f826ffe7-92dc-4f05-9298-1236513a1af2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 9c26ba65-f5a0-499b-9891-c84e1530f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance aae9f4f0-aeda-4008-aaf7-0bc42fa24be4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:10:28 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 26f6d35a-d2e0-4ec3-b482-4d66593d0207 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:10:28 user nova-compute[72426]: INFO nova.compute.manager [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] instance snapshotting
Aug 01 08:10:28 user nova-compute[72426]: INFO nova.compute.manager [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Took 39.44 seconds to build instance.
Aug 01 08:10:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c3e560a1-a6f0-40ce-bf21-ffe2f7261a40 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.561s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:28 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Beginning live snapshot process
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:10:28 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.420s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:10:29 user nova-compute[72426]: INFO nova.compute.claims [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Claim successful on node user
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json -f qcow2 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.network.neutron [req-8ff03eba-ea85-4969-abde-1144e3f3e5ff req-beac9177-a43b-4c3b-999c-6ba9e6a647b0 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updated VIF entry in instance network info cache for port 883a5e52-3445-4ce9-aebd-8a5c59e18e63. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.network.neutron [req-8ff03eba-ea85-4969-abde-1144e3f3e5ff req-beac9177-a43b-4c3b-999c-6ba9e6a647b0 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updating instance_info_cache with network_info: [{"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ff03eba-ea85-4969-abde-1144e3f3e5ff req-beac9177-a43b-4c3b-999c-6ba9e6a647b0 service nova] Releasing lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json -f qcow2 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphpun22n6/3da0e1e988574100993bcac8eefabdcb.delta 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphpun22n6/3da0e1e988574100993bcac8eefabdcb.delta 1073741824" returned: 0 in 0.045s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:10:29 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72426) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 01 08:10:29 user nova-compute[72426]: INFO nova.virt.libvirt.host [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] UEFI support detected
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:10:29 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:10:29 user nova-compute[72426]: INFO nova.virt.block_device [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Booting with volume snapshot 73b7f8a9-718a-41cd-8a88-46ccb89067a2 at /dev/vda
Aug 01 08:10:29 user nova-compute[72426]: DEBUG nova.policy [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49f9ffcf2a8a435a968fd41590d90607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f71856fa7cb47b998a77b3f4ba436d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:10:30 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:10:30 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:10:30 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:10:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:10:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:10:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:10:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72426) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 08:10:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72426) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 08:10:30 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 08:10:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Successfully created port: 5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:10:30 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:10:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphpun22n6/3da0e1e988574100993bcac8eefabdcb.delta /opt/stack/data/nova/instances/snapshots/tmphpun22n6/3da0e1e988574100993bcac8eefabdcb {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updating instance_info_cache with network_info: [{"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphpun22n6/3da0e1e988574100993bcac8eefabdcb.delta /opt/stack/data/nova/instances/snapshots/tmphpun22n6/3da0e1e988574100993bcac8eefabdcb" returned: 0 in 0.608s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:31 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Snapshot extracted, beginning image upload
Aug 01 08:10:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Successfully updated port: 5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "refresh_cache-26f6d35a-d2e0-4ec3-b482-4d66593d0207" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquired lock "refresh_cache-26f6d35a-d2e0-4ec3-b482-4d66593d0207" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:10:31 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-d5005580-0d47-456a-be32-730faa91d8d1 req-c39fd584-6cfb-4736-a7a2-088c5ae34ef0 service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received event network-changed-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-d5005580-0d47-456a-be32-730faa91d8d1 req-c39fd584-6cfb-4736-a7a2-088c5ae34ef0 service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Refreshing instance network info cache due to event network-changed-5f2dee5e-5857-42c8-8937-d8207d3142b7. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d5005580-0d47-456a-be32-730faa91d8d1 req-c39fd584-6cfb-4736-a7a2-088c5ae34ef0 service nova] Acquiring lock "refresh_cache-26f6d35a-d2e0-4ec3-b482-4d66593d0207" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Updating instance_info_cache with network_info: [{"id": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "address": "fa:16:3e:2b:83:df", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2dee5e-58", "ovs_interfaceid": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Releasing lock "refresh_cache-26f6d35a-d2e0-4ec3-b482-4d66593d0207" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Instance network_info: |[{"id": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "address": "fa:16:3e:2b:83:df", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2dee5e-58", "ovs_interfaceid": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d5005580-0d47-456a-be32-730faa91d8d1 req-c39fd584-6cfb-4736-a7a2-088c5ae34ef0 service nova] Acquired lock "refresh_cache-26f6d35a-d2e0-4ec3-b482-4d66593d0207" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG nova.network.neutron [req-d5005580-0d47-456a-be32-730faa91d8d1 req-c39fd584-6cfb-4736-a7a2-088c5ae34ef0 service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Refreshing network info cache for port 5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPvTfRko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:32 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:32 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:32 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd9b41c-ee60-48fb-bd71-e6661c31a55b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:10:32 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa69487a-6f72-48cd-a30a-0639dc038185]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551] added
Aug 01 08:10:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[381d5a3d-e9ba-4ff2-b4d8-9dba80588c0d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0a557d-b0b1-4183-81a0-8494efa8fadd]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPvTfRko {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPvTfRko" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1b3c72-d80e-47e8-8133-8f922b179515]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BPvTfRko'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[69889254-5105-479c-8e17-9869d94d708c]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[848ab1ea-c297-4805-9d29-17b138d43ff7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:32 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:32 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:32 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:32 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG nova.network.neutron [req-d5005580-0d47-456a-be32-730faa91d8d1 req-c39fd584-6cfb-4736-a7a2-088c5ae34ef0 service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Updated VIF entry in instance network info cache for port 5f2dee5e-5857-42c8-8937-d8207d3142b7. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG nova.network.neutron [req-d5005580-0d47-456a-be32-730faa91d8d1 req-c39fd584-6cfb-4736-a7a2-088c5ae34ef0 service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Updating instance_info_cache with network_info: [{"id": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "address": "fa:16:3e:2b:83:df", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2dee5e-58", "ovs_interfaceid": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d5005580-0d47-456a-be32-730faa91d8d1 req-c39fd584-6cfb-4736-a7a2-088c5ae34ef0 service nova] Releasing lock "refresh_cache-26f6d35a-d2e0-4ec3-b482-4d66593d0207" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabcef64-3a45-4025-b4cd-2be6da5f99b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551, portal: 172.16.0.220,3260]
Aug 01 08:10:32 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551, portal: 172.16.0.220,3260] successful.
Aug 01 08:10:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f6bad-d45e-41f9-93f5-338dfd45a628]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3904c36e-8cc9-45a7-b9c1-cab5f8019fab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:32 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:32 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:32 user nova-compute[72426]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 (non-flash)
Aug 01 08:10:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:32 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:32 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:32 user nova-compute[72426]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 (non-flash)
Aug 01 08:10:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b82683a-45df-46f8-9f59-03217f1d4998]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:10:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPvTfRko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:10:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23662623661353234', 'path': '/dev/sde'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662623661353234', 'path': '/dev/sde'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:10:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lazy-loading 'flavor' on Instance uuid 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:10:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:10:33 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:10:33 user nova-compute[72426]:   <source dev="/dev/sde"/>
Aug 01 08:10:33 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:10:33 user nova-compute[72426]:   <serial>1d5654c0-3da9-4e3f-9512-9d21b2d4f551</serial>
Aug 01 08:10:33 user nova-compute[72426]: </disk>
Aug 01 08:10:33 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:10:34 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Snapshot image upload complete
Aug 01 08:10:34 user nova-compute[72426]: INFO nova.compute.manager [None req-0e7fbdfa-8778-4033-84c2-85ec3ab3e8e9 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Took 5.61 seconds to snapshot the instance on the hypervisor.
Aug 01 08:10:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:10:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:10:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] No VIF found with MAC fa:16:3e:b9:c8:44, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:10:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-9705ba21-97ea-4f16-ab28-96dccf30d389 req-8bccf3fc-a5f2-4e01-a894-d8ba8ff7bd57 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-changed-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-9705ba21-97ea-4f16-ab28-96dccf30d389 req-8bccf3fc-a5f2-4e01-a894-d8ba8ff7bd57 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Refreshing instance network info cache due to event network-changed-197ec10c-39a4-4c89-b675-b7bb2ee90b1f. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:10:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9705ba21-97ea-4f16-ab28-96dccf30d389 req-8bccf3fc-a5f2-4e01-a894-d8ba8ff7bd57 service nova] Acquiring lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:10:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9705ba21-97ea-4f16-ab28-96dccf30d389 req-8bccf3fc-a5f2-4e01-a894-d8ba8ff7bd57 service nova] Acquired lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:10:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-9705ba21-97ea-4f16-ab28-96dccf30d389 req-8bccf3fc-a5f2-4e01-a894-d8ba8ff7bd57 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Refreshing network info cache for port 197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:10:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2be91486-3828-4a7c-8e66-5b71765207dd tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.659s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:35 user nova-compute[72426]: INFO nova.compute.manager [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Terminating instance
Aug 01 08:10:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-9705ba21-97ea-4f16-ab28-96dccf30d389 req-8bccf3fc-a5f2-4e01-a894-d8ba8ff7bd57 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updated VIF entry in instance network info cache for port 197ec10c-39a4-4c89-b675-b7bb2ee90b1f. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-9705ba21-97ea-4f16-ab28-96dccf30d389 req-8bccf3fc-a5f2-4e01-a894-d8ba8ff7bd57 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance_info_cache with network_info: [{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9705ba21-97ea-4f16-ab28-96dccf30d389 req-8bccf3fc-a5f2-4e01-a894-d8ba8ff7bd57 service nova] Releasing lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.utils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1650b067-17d2-4c1b-b6cb-1f19c0127311]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13c9a3b-c205-4438-9197-771ee70a3da5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38e2f1f-e054-4a7b-b079-fe9fb8163999]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db21a0e-8ce4-4a84-a2ab-3f2dbaa44040]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:35 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Instance destroyed successfully.
Aug 01 08:10:35 user nova-compute[72426]: DEBUG nova.objects.instance [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lazy-loading 'resources' on Instance uuid 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:35 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6dfff6-b195-4c8b-a79d-77f803d64195]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.utils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Updating existing volume attachment record: fe7029bc-69e5-4ff3-aacb-da36f7269c2d {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1965145044',display_name='tempest-DeleteServersTestJSON-server-1965145044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1965145044',id=1,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:08:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='388b1904f2c2472abebf36d33593183a',ramdisk_id='',reservation_id='r-3h74iogq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-588657060',owner_user_name='tempest-DeleteServersTestJSON-588657060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:08:48Z,user_data=None,user_id='decf869dd36044cf9f59e37c338ff0e5',uuid=223b6e2a-f0fc-46e7-93e2-7e6a98abba8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Converting VIF {"id": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "address": "fa:16:3e:b9:c8:44", "network": {"id": "3ebb75c1-9889-4132-ae11-4a4992bc34b6", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1910815273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "388b1904f2c2472abebf36d33593183a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1b41d27-7b", "ovs_interfaceid": "d1b41d27-7b3c-4f7b-b823-7e1b3f835922", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:c8:44,bridge_name='br-int',has_traffic_filtering=True,id=d1b41d27-7b3c-4f7b-b823-7e1b3f835922,network=Network(3ebb75c1-9889-4132-ae11-4a4992bc34b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b41d27-7b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_vif [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:c8:44,bridge_name='br-int',has_traffic_filtering=True,id=d1b41d27-7b3c-4f7b-b823-7e1b3f835922,network=Network(3ebb75c1-9889-4132-ae11-4a4992bc34b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b41d27-7b') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1b41d27-7b, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:35 user nova-compute[72426]: INFO os_vif [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:c8:44,bridge_name='br-int',has_traffic_filtering=True,id=d1b41d27-7b3c-4f7b-b823-7e1b3f835922,network=Network(3ebb75c1-9889-4132-ae11-4a4992bc34b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1b41d27-7b')
Aug 01 08:10:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPvTfRko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:35 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e626b52b-94f5-46ff-bcbc-6b0d4fe94fc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6502e0df-57fc-4360-9d27-8ad54ad4183f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:35 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:35 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:35 user nova-compute[72426]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 (non-flash)
Aug 01 08:10:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:35 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:35 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:35 user nova-compute[72426]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 (non-flash)
Aug 01 08:10:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c3e52d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551'): ({'sde'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Removing single pathed devices sde {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:10:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f27c3de-20f6-4ec9-bd12-47fadc0d5354]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea02d8-57b0-43e1-a427-27df2325f770]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Flushing IO for device /dev/sde {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a1c19a-8afa-4aa9-9382-81bf32d7e489]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5224e2-013d-4882-a193-646f628e552f]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] SCSI volumes sde have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5868b7-09fb-402a-ba22-ef822e5bd176]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17609a9-b9ee-4405-a263-8d9f9e1cc32c]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551, portal: 172.16.0.220,3260]
Aug 01 08:10:36 user nova-compute[72426]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551, portal: 172.16.0.220,3260] successful.
Aug 01 08:10:36 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5654c0-3da9-4e3f-9512-9d21b2d4f551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[01334e7b-f8e5-44d1-a90a-48d10ba88f96]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] <== disconnect_volume: return (288ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:10:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Deleting instance files /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a_del
Aug 01 08:10:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Deletion of /opt/stack/data/nova/instances/223b6e2a-f0fc-46e7-93e2-7e6a98abba8a_del complete
Aug 01 08:10:36 user nova-compute[72426]: INFO nova.compute.manager [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Received event network-vif-unplugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] Acquiring lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] No waiting events found dispatching network-vif-unplugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Received event network-vif-unplugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Received event network-vif-plugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] Acquiring lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] No waiting events found dispatching network-vif-plugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:36 user nova-compute[72426]: WARNING nova.compute.manager [req-bc2ce9a5-895f-4a11-94db-74d39ce3b7cd req-6ff4b9de-8bf2-45cc-86a7-f1d12fe28e38 service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Received unexpected event network-vif-plugged-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 for instance with vm_state active and task_state deleting.
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:36 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Took 0.63 seconds to deallocate network for instance.
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-559ead83-23f0-444c-84db-0dc0f0f5a6f4 req-03ef95c2-bd6b-4e76-b6c2-45508184bfae service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Received event network-vif-deleted-d1b41d27-7b3c-4f7b-b823-7e1b3f835922 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:36 user nova-compute[72426]: INFO nova.compute.manager [req-559ead83-23f0-444c-84db-0dc0f0f5a6f4 req-03ef95c2-bd6b-4e76-b6c2-45508184bfae service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Neutron deleted interface d1b41d27-7b3c-4f7b-b823-7e1b3f835922; detaching it from the instance and deleting it from the info cache
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.network.neutron [req-559ead83-23f0-444c-84db-0dc0f0f5a6f4 req-03ef95c2-bd6b-4e76-b6c2-45508184bfae service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-559ead83-23f0-444c-84db-0dc0f0f5a6f4 req-03ef95c2-bd6b-4e76-b6c2-45508184bfae service nova] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Detach interface failed, port_id=d1b41d27-7b3c-4f7b-b823-7e1b3f835922, reason: Instance 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:10:37 user nova-compute[72426]: INFO nova.compute.manager [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Took 0.76 seconds to detach 1 volumes for instance.
Aug 01 08:10:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:38 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:10:38 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:10:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:38 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Deleted allocations for instance 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a
Aug 01 08:10:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3b51cd58-0ef4-40fb-a569-e40a92a80221 tempest-DeleteServersTestJSON-588657060 tempest-DeleteServersTestJSON-588657060-project-member] Lock "223b6e2a-f0fc-46e7-93e2-7e6a98abba8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.250s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:10:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Creating image(s)
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Ensure instance console log exists: /opt/stack/data/nova/instances/26f6d35a-d2e0-4ec3-b482-4d66593d0207/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Start _get_guest_xml network_info=[{"id": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "address": "fa:16:3e:2b:83:df", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2dee5e-58", "ovs_interfaceid": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLiSjqDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26f6d35a-d2e0-4ec3-b482-4d66593d0207', 'attached_at': '', 'detached_at': '', 'volume_id': '1bce268c-1a04-4d20-ae05-32161638368a', 'serial': '1bce268c-1a04-4d20-ae05-32161638368a'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'fe7029bc-69e5-4ff3-aacb-da36f7269c2d', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:10:43 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:10:43 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLiSjqDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:43 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:43 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:10:43 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa204f4c-2696-4c44-ad88-6aaa0a9e7073]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:10:43 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93804af-5055-49e4-9cd2-afa501212f98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a] added
Aug 01 08:10:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d1b1ab-688f-41d8-bb8b-1abfd3f99b69]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c367ed-a6e9-44f0-acb4-efed19c70689]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLiSjqDM {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uLiSjqDM" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4436011c-57ca-4f28-908b-e907658422db]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uLiSjqDM'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6d8b65-061c-4f19-b3db-6d635e9ac03d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcee55e5-8093-434f-9502-65005ab03092]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:43 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:43 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:43 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:43 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e7fc45-2cad-4b5f-9593-1f3a27f8c57a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a, portal: 172.16.0.220,3260]
Aug 01 08:10:43 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a, portal: 172.16.0.220,3260] successful.
Aug 01 08:10:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[85711aa0-c0e7-4e15-b86b-0ee79d10d7cf]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9357e031-b29c-4a5f-90a0-c8246a75acdb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:43 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:43 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:43 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:10:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:10:43 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:10:43 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:10:43 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:10:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[623b6e40-c8e4-418c-b577-4ed9d46cfe46]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:10:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLiSjqDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23762313932366538', 'path': '/dev/sde'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762313932366538', 'path': '/dev/sde'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1871066471',display_name='tempest-TestVolumeBootPattern-server-1871066471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1871066471',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-4t4kuotq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:10:30Z,user_data=None,user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=26f6d35a-d2e0-4ec3-b482-4d66593d0207,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "address": "fa:16:3e:2b:83:df", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2dee5e-58", "ovs_interfaceid": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "address": "fa:16:3e:2b:83:df", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2dee5e-58", "ovs_interfaceid": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:83:df,bridge_name='br-int',has_traffic_filtering=True,id=5f2dee5e-5857-42c8-8937-d8207d3142b7,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2dee5e-58') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG nova.objects.instance [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lazy-loading 'pci_devices' on Instance uuid 26f6d35a-d2e0-4ec3-b482-4d66593d0207 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:10:44 user nova-compute[72426]:   <uuid>26f6d35a-d2e0-4ec3-b482-4d66593d0207</uuid>
Aug 01 08:10:44 user nova-compute[72426]:   <name>instance-0000000b</name>
Aug 01 08:10:44 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:10:44 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:10:44 user nova-compute[72426]:   <metadata>
Aug 01 08:10:44 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:10:44 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:10:44 user nova-compute[72426]:       <nova:name>tempest-TestVolumeBootPattern-server-1871066471</nova:name>
Aug 01 08:10:44 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:10:43</nova:creationTime>
Aug 01 08:10:44 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:10:44 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:10:44 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:10:44 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:10:44 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:10:44 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:10:44 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:10:44 user nova-compute[72426]:       <nova:owner>
Aug 01 08:10:44 user nova-compute[72426]:         <nova:user uuid="49f9ffcf2a8a435a968fd41590d90607">tempest-TestVolumeBootPattern-942085866-project-member</nova:user>
Aug 01 08:10:44 user nova-compute[72426]:         <nova:project uuid="6f71856fa7cb47b998a77b3f4ba436d7">tempest-TestVolumeBootPattern-942085866</nova:project>
Aug 01 08:10:44 user nova-compute[72426]:       </nova:owner>
Aug 01 08:10:44 user nova-compute[72426]:       <nova:ports>
Aug 01 08:10:44 user nova-compute[72426]:         <nova:port uuid="5f2dee5e-5857-42c8-8937-d8207d3142b7">
Aug 01 08:10:44 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 08:10:44 user nova-compute[72426]:         </nova:port>
Aug 01 08:10:44 user nova-compute[72426]:       </nova:ports>
Aug 01 08:10:44 user nova-compute[72426]:     </nova:instance>
Aug 01 08:10:44 user nova-compute[72426]:   </metadata>
Aug 01 08:10:44 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:10:44 user nova-compute[72426]:     <system>
Aug 01 08:10:44 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:10:44 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:10:44 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:10:44 user nova-compute[72426]:       <entry name="serial">26f6d35a-d2e0-4ec3-b482-4d66593d0207</entry>
Aug 01 08:10:44 user nova-compute[72426]:       <entry name="uuid">26f6d35a-d2e0-4ec3-b482-4d66593d0207</entry>
Aug 01 08:10:44 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:10:44 user nova-compute[72426]:     </system>
Aug 01 08:10:44 user nova-compute[72426]:   </sysinfo>
Aug 01 08:10:44 user nova-compute[72426]:   <os>
Aug 01 08:10:44 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:10:44 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:10:44 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:10:44 user nova-compute[72426]:   </os>
Aug 01 08:10:44 user nova-compute[72426]:   <features>
Aug 01 08:10:44 user nova-compute[72426]:     <acpi/>
Aug 01 08:10:44 user nova-compute[72426]:     <apic/>
Aug 01 08:10:44 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:10:44 user nova-compute[72426]:   </features>
Aug 01 08:10:44 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:10:44 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:10:44 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:10:44 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:10:44 user nova-compute[72426]:   </clock>
Aug 01 08:10:44 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:10:44 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:10:44 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:10:44 user nova-compute[72426]:   </cpu>
Aug 01 08:10:44 user nova-compute[72426]:   <devices>
Aug 01 08:10:44 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:10:44 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:10:44 user nova-compute[72426]:       <source dev="/dev/sde"/>
Aug 01 08:10:44 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:10:44 user nova-compute[72426]:       <serial>1bce268c-1a04-4d20-ae05-32161638368a</serial>
Aug 01 08:10:44 user nova-compute[72426]:     </disk>
Aug 01 08:10:44 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:10:44 user nova-compute[72426]:       <mac address="fa:16:3e:2b:83:df"/>
Aug 01 08:10:44 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:10:44 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:10:44 user nova-compute[72426]:       <target dev="tap5f2dee5e-58"/>
Aug 01 08:10:44 user nova-compute[72426]:     </interface>
Aug 01 08:10:44 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:10:44 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/26f6d35a-d2e0-4ec3-b482-4d66593d0207/console.log" append="off"/>
Aug 01 08:10:44 user nova-compute[72426]:     </serial>
Aug 01 08:10:44 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:10:44 user nova-compute[72426]:     <video>
Aug 01 08:10:44 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:10:44 user nova-compute[72426]:     </video>
Aug 01 08:10:44 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:10:44 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:10:44 user nova-compute[72426]:     </rng>
Aug 01 08:10:44 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:10:44 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:10:44 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:10:44 user nova-compute[72426]:     </memballoon>
Aug 01 08:10:44 user nova-compute[72426]:   </devices>
Aug 01 08:10:44 user nova-compute[72426]: </domain>
Aug 01 08:10:44 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1871066471',display_name='tempest-TestVolumeBootPattern-server-1871066471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1871066471',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-4t4kuotq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:10:30Z,user_data=None,user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=26f6d35a-d2e0-4ec3-b482-4d66593d0207,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "address": "fa:16:3e:2b:83:df", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2dee5e-58", "ovs_interfaceid": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "address": "fa:16:3e:2b:83:df", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2dee5e-58", "ovs_interfaceid": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:83:df,bridge_name='br-int',has_traffic_filtering=True,id=5f2dee5e-5857-42c8-8937-d8207d3142b7,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2dee5e-58') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG os_vif [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:83:df,bridge_name='br-int',has_traffic_filtering=True,id=5f2dee5e-5857-42c8-8937-d8207d3142b7,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2dee5e-58') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f2dee5e-58, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f2dee5e-58, col_values=(('external_ids', {'iface-id': '5f2dee5e-5857-42c8-8937-d8207d3142b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:83:df', 'vm-uuid': '26f6d35a-d2e0-4ec3-b482-4d66593d0207'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:44 user nova-compute[72426]: INFO os_vif [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:83:df,bridge_name='br-int',has_traffic_filtering=True,id=5f2dee5e-5857-42c8-8937-d8207d3142b7,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2dee5e-58')
Aug 01 08:10:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:10:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] No VIF found with MAC fa:16:3e:2b:83:df, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:10:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-1c01b214-40cd-4b4e-9d91-f51db16fd7d9 req-70c8057e-f8cf-4717-8795-8d83aece811c service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received event network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1c01b214-40cd-4b4e-9d91-f51db16fd7d9 req-70c8057e-f8cf-4717-8795-8d83aece811c service nova] Acquiring lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1c01b214-40cd-4b4e-9d91-f51db16fd7d9 req-70c8057e-f8cf-4717-8795-8d83aece811c service nova] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1c01b214-40cd-4b4e-9d91-f51db16fd7d9 req-70c8057e-f8cf-4717-8795-8d83aece811c service nova] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-1c01b214-40cd-4b4e-9d91-f51db16fd7d9 req-70c8057e-f8cf-4717-8795-8d83aece811c service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] No waiting events found dispatching network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:46 user nova-compute[72426]: WARNING nova.compute.manager [req-1c01b214-40cd-4b4e-9d91-f51db16fd7d9 req-70c8057e-f8cf-4717-8795-8d83aece811c service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received unexpected event network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 for instance with vm_state building and task_state spawning.
Aug 01 08:10:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:48 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877448.996798, 26f6d35a-d2e0-4ec3-b482-4d66593d0207 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:10:48 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] VM Resumed (Lifecycle Event)
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:10:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Instance spawned successfully.
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-f880702b-cd6d-4a1b-932d-faac08ea94d4 req-7e6fa264-6fbc-4a40-940a-0f113d189f9c service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received event network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f880702b-cd6d-4a1b-932d-faac08ea94d4 req-7e6fa264-6fbc-4a40-940a-0f113d189f9c service nova] Acquiring lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f880702b-cd6d-4a1b-932d-faac08ea94d4 req-7e6fa264-6fbc-4a40-940a-0f113d189f9c service nova] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f880702b-cd6d-4a1b-932d-faac08ea94d4 req-7e6fa264-6fbc-4a40-940a-0f113d189f9c service nova] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-f880702b-cd6d-4a1b-932d-faac08ea94d4 req-7e6fa264-6fbc-4a40-940a-0f113d189f9c service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] No waiting events found dispatching network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:49 user nova-compute[72426]: WARNING nova.compute.manager [req-f880702b-cd6d-4a1b-932d-faac08ea94d4 req-7e6fa264-6fbc-4a40-940a-0f113d189f9c service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received unexpected event network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 for instance with vm_state building and task_state spawning.
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:10:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877449.001032, 26f6d35a-d2e0-4ec3-b482-4d66593d0207 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:10:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] VM Started (Lifecycle Event)
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:10:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:10:49 user nova-compute[72426]: INFO nova.compute.manager [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 01 08:10:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:10:49 user nova-compute[72426]: INFO nova.compute.manager [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Took 20.67 seconds to build instance.
Aug 01 08:10:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa40d45c-cb6b-4bf6-92e1-073ae7d1b4aa tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.858s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:50 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877435.8388522, 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:10:50 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] VM Stopped (Lifecycle Event)
Aug 01 08:10:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-89cfbe90-c838-4179-9704-cfaa2e9fef63 None None] [instance: 223b6e2a-f0fc-46e7-93e2-7e6a98abba8a] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:10:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-39c47f6d-e9a3-45f0-9ba8-03478d4d3c8a req-406fcfb4-0101-437f-bdd0-1ebc946077da service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received event network-changed-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-39c47f6d-e9a3-45f0-9ba8-03478d4d3c8a req-406fcfb4-0101-437f-bdd0-1ebc946077da service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Refreshing instance network info cache due to event network-changed-0e7037af-0c00-4388-a819-04af9c0a565c. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:10:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-39c47f6d-e9a3-45f0-9ba8-03478d4d3c8a req-406fcfb4-0101-437f-bdd0-1ebc946077da service nova] Acquiring lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:10:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-39c47f6d-e9a3-45f0-9ba8-03478d4d3c8a req-406fcfb4-0101-437f-bdd0-1ebc946077da service nova] Acquired lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:10:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-39c47f6d-e9a3-45f0-9ba8-03478d4d3c8a req-406fcfb4-0101-437f-bdd0-1ebc946077da service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Refreshing network info cache for port 0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:10:51 user nova-compute[72426]: DEBUG nova.network.neutron [req-39c47f6d-e9a3-45f0-9ba8-03478d4d3c8a req-406fcfb4-0101-437f-bdd0-1ebc946077da service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Updated VIF entry in instance network info cache for port 0e7037af-0c00-4388-a819-04af9c0a565c. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:10:51 user nova-compute[72426]: DEBUG nova.network.neutron [req-39c47f6d-e9a3-45f0-9ba8-03478d4d3c8a req-406fcfb4-0101-437f-bdd0-1ebc946077da service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Updating instance_info_cache with network_info: [{"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-39c47f6d-e9a3-45f0-9ba8-03478d4d3c8a req-406fcfb4-0101-437f-bdd0-1ebc946077da service nova] Releasing lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:10:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-94101d4b-313d-4560-8078-8d7958be1a22 req-404ad605-a5da-4de2-9833-e6003608c565 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received event network-changed-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-94101d4b-313d-4560-8078-8d7958be1a22 req-404ad605-a5da-4de2-9833-e6003608c565 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Refreshing instance network info cache due to event network-changed-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:10:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-94101d4b-313d-4560-8078-8d7958be1a22 req-404ad605-a5da-4de2-9833-e6003608c565 service nova] Acquiring lock "refresh_cache-ace240ab-fe78-416a-b45a-85d66b8ac8cd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:10:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-94101d4b-313d-4560-8078-8d7958be1a22 req-404ad605-a5da-4de2-9833-e6003608c565 service nova] Acquired lock "refresh_cache-ace240ab-fe78-416a-b45a-85d66b8ac8cd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:10:52 user nova-compute[72426]: DEBUG nova.network.neutron [req-94101d4b-313d-4560-8078-8d7958be1a22 req-404ad605-a5da-4de2-9833-e6003608c565 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Refreshing network info cache for port aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:10:53 user nova-compute[72426]: DEBUG nova.network.neutron [req-94101d4b-313d-4560-8078-8d7958be1a22 req-404ad605-a5da-4de2-9833-e6003608c565 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Updated VIF entry in instance network info cache for port aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:10:53 user nova-compute[72426]: DEBUG nova.network.neutron [req-94101d4b-313d-4560-8078-8d7958be1a22 req-404ad605-a5da-4de2-9833-e6003608c565 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Updating instance_info_cache with network_info: [{"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-94101d4b-313d-4560-8078-8d7958be1a22 req-404ad605-a5da-4de2-9833-e6003608c565 service nova] Releasing lock "refresh_cache-ace240ab-fe78-416a-b45a-85d66b8ac8cd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:10:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Acquiring lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Acquiring lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:55 user nova-compute[72426]: INFO nova.compute.manager [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Terminating instance
Aug 01 08:10:55 user nova-compute[72426]: DEBUG nova.compute.manager [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-e839d056-6896-4e8d-a662-7eea588440e2 req-307416b6-7b9e-4bf8-acfb-14bbbee01a7a service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Received event network-vif-unplugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e839d056-6896-4e8d-a662-7eea588440e2 req-307416b6-7b9e-4bf8-acfb-14bbbee01a7a service nova] Acquiring lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e839d056-6896-4e8d-a662-7eea588440e2 req-307416b6-7b9e-4bf8-acfb-14bbbee01a7a service nova] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e839d056-6896-4e8d-a662-7eea588440e2 req-307416b6-7b9e-4bf8-acfb-14bbbee01a7a service nova] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-e839d056-6896-4e8d-a662-7eea588440e2 req-307416b6-7b9e-4bf8-acfb-14bbbee01a7a service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] No waiting events found dispatching network-vif-unplugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-e839d056-6896-4e8d-a662-7eea588440e2 req-307416b6-7b9e-4bf8-acfb-14bbbee01a7a service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Received event network-vif-unplugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:10:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Instance destroyed successfully.
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.objects.instance [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lazy-loading 'resources' on Instance uuid 7f0c3f3b-a037-4925-8fff-089cc5c5b759 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1109490873',display_name='tempest-VolumesActionsTest-instance-1109490873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1109490873',id=5,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:09:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50e69adfe29f4af2ab57772c309b7c7b',ramdisk_id='',reservation_id='r-45tpqnxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-46354128',owner_user_name='tempest-VolumesActionsTest-46354128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:09:13Z,user_data=None,user_id='1b5f10cb5e124b6c9ee4a98a94670d8c',uuid=7f0c3f3b-a037-4925-8fff-089cc5c5b759,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "address": "fa:16:3e:af:c9:16", "network": {"id": "9876c05a-ab1b-4f00-9617-093cea90fe21", "bridge": "br-int", "label": "tempest-VolumesActionsTest-619969235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e69adfe29f4af2ab57772c309b7c7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa3adeb-3a", "ovs_interfaceid": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Converting VIF {"id": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "address": "fa:16:3e:af:c9:16", "network": {"id": "9876c05a-ab1b-4f00-9617-093cea90fe21", "bridge": "br-int", "label": "tempest-VolumesActionsTest-619969235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50e69adfe29f4af2ab57772c309b7c7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa3adeb-3a", "ovs_interfaceid": "faa3adeb-3aa5-4f09-9dfe-6c101a39233c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=faa3adeb-3aa5-4f09-9dfe-6c101a39233c,network=Network(9876c05a-ab1b-4f00-9617-093cea90fe21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa3adeb-3a') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG os_vif [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=faa3adeb-3aa5-4f09-9dfe-6c101a39233c,network=Network(9876c05a-ab1b-4f00-9617-093cea90fe21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa3adeb-3a') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfaa3adeb-3a, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:56 user nova-compute[72426]: INFO os_vif [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c9:16,bridge_name='br-int',has_traffic_filtering=True,id=faa3adeb-3aa5-4f09-9dfe-6c101a39233c,network=Network(9876c05a-ab1b-4f00-9617-093cea90fe21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa3adeb-3a')
Aug 01 08:10:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Deleting instance files /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759_del
Aug 01 08:10:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Deletion of /opt/stack/data/nova/instances/7f0c3f3b-a037-4925-8fff-089cc5c5b759_del complete
Aug 01 08:10:56 user nova-compute[72426]: INFO nova.compute.manager [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.objects.instance [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lazy-loading 'flavor' on Instance uuid ace240ab-fe78-416a-b45a-85d66b8ac8cd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-16e258f5-6067-488b-b235-d82eab23f43e req-35d4995b-72c5-4856-b12c-fd3299e26f8a service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Received event network-vif-deleted-faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:56 user nova-compute[72426]: INFO nova.compute.manager [req-16e258f5-6067-488b-b235-d82eab23f43e req-35d4995b-72c5-4856-b12c-fd3299e26f8a service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Neutron deleted interface faa3adeb-3aa5-4f09-9dfe-6c101a39233c; detaching it from the instance and deleting it from the info cache
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.network.neutron [req-16e258f5-6067-488b-b235-d82eab23f43e req-35d4995b-72c5-4856-b12c-fd3299e26f8a service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:10:56 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Took 0.57 seconds to deallocate network for instance.
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-16e258f5-6067-488b-b235-d82eab23f43e req-35d4995b-72c5-4856-b12c-fd3299e26f8a service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Detach interface failed, port_id=faa3adeb-3aa5-4f09-9dfe-6c101a39233c, reason: Instance 7f0c3f3b-a037-4925-8fff-089cc5c5b759 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG nova.objects.instance [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lazy-loading 'flavor' on Instance uuid 457df7dd-4e0f-4d72-915b-644f0c8588eb {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:56 user nova-compute[72426]: INFO nova.compute.manager [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Attaching volume 584ea139-12fe-4274-9812-ce5bf252a99e to /dev/sdc
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.utils [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e785c665-89ed-4717-9f31-110e807f06fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[911eac7a-09a6-4408-b12b-cd3eea87df8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:57 user nova-compute[72426]: INFO nova.compute.manager [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Attaching volume 51aee390-ff74-4fa5-a068-0cd93c4a7bee to /dev/vdb
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aa4293-a9a2-49c3-b9e8-894ba565895b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a991ca-6864-49bd-9ee3-6e82b5564879]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:57 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5442d88-ec0e-4a46-80e4-26f0a647e456]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.utils [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Updating existing volume attachment record: b907a138-9158-4544-91cc-4713c91cbc6a {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.utils [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0dff44-3076-4273-b249-f3cd9e6337c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.714s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8528531-e424-4fd3-ba51-105861cde62c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e03a8c6-9e13-4353-8e50-fa5ef1ffa9a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:57 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Deleted allocations for instance 7f0c3f3b-a037-4925-8fff-089cc5c5b759
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01c56b7-f17e-43e3-b450-8fad4c6360c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:10:57 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f6458d-2393-4f82-9d7c-262c2d442344]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG os_brick.utils [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Updating existing volume attachment record: c6a4a8b9-8715-45b8-a3ad-f2445818c86b {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-df27fcd7-1820-4df7-9598-4bf5726c39af tempest-VolumesActionsTest-46354128 tempest-VolumesActionsTest-46354128-project-member] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.478s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-339b5c69-801f-4201-ae0d-f521d9de1d30 req-c6639630-eeb0-4079-ba52-1b6b92ee3bb3 service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Received event network-vif-plugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-339b5c69-801f-4201-ae0d-f521d9de1d30 req-c6639630-eeb0-4079-ba52-1b6b92ee3bb3 service nova] Acquiring lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-339b5c69-801f-4201-ae0d-f521d9de1d30 req-c6639630-eeb0-4079-ba52-1b6b92ee3bb3 service nova] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-339b5c69-801f-4201-ae0d-f521d9de1d30 req-c6639630-eeb0-4079-ba52-1b6b92ee3bb3 service nova] Lock "7f0c3f3b-a037-4925-8fff-089cc5c5b759-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:10:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-339b5c69-801f-4201-ae0d-f521d9de1d30 req-c6639630-eeb0-4079-ba52-1b6b92ee3bb3 service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] No waiting events found dispatching network-vif-plugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:10:57 user nova-compute[72426]: WARNING nova.compute.manager [req-339b5c69-801f-4201-ae0d-f521d9de1d30 req-c6639630-eeb0-4079-ba52-1b6b92ee3bb3 service nova] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Received unexpected event network-vif-plugged-faa3adeb-3aa5-4f09-9dfe-6c101a39233c for instance with vm_state deleted and task_state None.
Aug 01 08:11:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-e3bb55a4-c440-428e-a790-be4eb6d57d1f req-e9e35a8d-29d7-4a4a-920e-594230c593dc service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received event network-changed-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-e3bb55a4-c440-428e-a790-be4eb6d57d1f req-e9e35a8d-29d7-4a4a-920e-594230c593dc service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Refreshing instance network info cache due to event network-changed-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e3bb55a4-c440-428e-a790-be4eb6d57d1f req-e9e35a8d-29d7-4a4a-920e-594230c593dc service nova] Acquiring lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e3bb55a4-c440-428e-a790-be4eb6d57d1f req-e9e35a8d-29d7-4a4a-920e-594230c593dc service nova] Acquired lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG nova.network.neutron [req-e3bb55a4-c440-428e-a790-be4eb6d57d1f req-e9e35a8d-29d7-4a4a-920e-594230c593dc service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Refreshing network info cache for port b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lazy-loading 'flavor' on Instance uuid f826ffe7-92dc-4f05-9298-1236513a1af2 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:02 user nova-compute[72426]: INFO nova.compute.manager [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Attaching volume fc631164-acbf-4ad5-a948-f02ccf95e320 to /dev/vdb
Aug 01 08:11:02 user nova-compute[72426]: DEBUG nova.network.neutron [req-e3bb55a4-c440-428e-a790-be4eb6d57d1f req-e9e35a8d-29d7-4a4a-920e-594230c593dc service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Updated VIF entry in instance network info cache for port b624f3e1-a1cb-4147-89de-7f2bf45ac4c8. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG nova.network.neutron [req-e3bb55a4-c440-428e-a790-be4eb6d57d1f req-e9e35a8d-29d7-4a4a-920e-594230c593dc service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Updating instance_info_cache with network_info: [{"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e3bb55a4-c440-428e-a790-be4eb6d57d1f req-e9e35a8d-29d7-4a4a-920e-594230c593dc service nova] Releasing lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG os_brick.utils [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[89760ab3-3c00-436a-aff5-adb306bbdda8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e2e30e-2721-48c1-a8e5-9560ceddb850]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48fd575-84d0-4442-aad9-edeee420503a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dbf718-0761-4a43-8651-9ab224f230cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:11:03 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:11:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccd5e31-5e98-47b8-a533-8d5731605189]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG os_brick.utils [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:03 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Updating existing volume attachment record: 46fb3714-2907-4517-b915-946d1457192e {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-1ef3bc36-348e-4a63-ab51-dccc2a2c6ad5 req-ff580aee-16f4-4ddf-9148-083c9ac41d2f service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-changed-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-1ef3bc36-348e-4a63-ab51-dccc2a2c6ad5 req-ff580aee-16f4-4ddf-9148-083c9ac41d2f service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Refreshing instance network info cache due to event network-changed-7525e311-6c46-4621-94e5-96940d9e88bd. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1ef3bc36-348e-4a63-ab51-dccc2a2c6ad5 req-ff580aee-16f4-4ddf-9148-083c9ac41d2f service nova] Acquiring lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1ef3bc36-348e-4a63-ab51-dccc2a2c6ad5 req-ff580aee-16f4-4ddf-9148-083c9ac41d2f service nova] Acquired lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG nova.network.neutron [req-1ef3bc36-348e-4a63-ab51-dccc2a2c6ad5 req-ff580aee-16f4-4ddf-9148-083c9ac41d2f service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Refreshing network info cache for port 7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "interface-9c26ba65-f5a0-499b-9891-c84e1530f40f-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "interface-9c26ba65-f5a0-499b-9891-c84e1530f40f-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lazy-loading 'flavor' on Instance uuid 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG nova.network.neutron [req-1ef3bc36-348e-4a63-ab51-dccc2a2c6ad5 req-ff580aee-16f4-4ddf-9148-083c9ac41d2f service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updated VIF entry in instance network info cache for port 7525e311-6c46-4621-94e5-96940d9e88bd. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG nova.network.neutron [req-1ef3bc36-348e-4a63-ab51-dccc2a2c6ad5 req-ff580aee-16f4-4ddf-9148-083c9ac41d2f service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updating instance_info_cache with network_info: [{"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1ef3bc36-348e-4a63-ab51-dccc2a2c6ad5 req-ff580aee-16f4-4ddf-9148-083c9ac41d2f service nova] Releasing lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lazy-loading 'pci_requests' on Instance uuid 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:05 user nova-compute[72426]: DEBUG nova.network.neutron [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:11:06 user nova-compute[72426]: DEBUG nova.policy [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '641e3764d33b496ca438a15c878f9be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454252382eb548feadc6ea9d263ced60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:11:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:06 user nova-compute[72426]: DEBUG nova.network.neutron [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Successfully created port: 2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAELJHzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:07 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:07 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:07 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG nova.network.neutron [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Successfully updated port: 2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58a92cc-af5c-4f03-8005-18eb7ad69335]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:11:07 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquired lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG nova.network.neutron [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6af5486-0bcd-4440-9d68-17f15803b56b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e] added
Aug 01 08:11:07 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d821d645-1d14-4861-9a46-89aa89524527]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-3ef6d03e-77dd-4f5e-8859-93432c6c813d req-e2d0d69d-eefc-4ede-b24a-2314af8da33e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-changed-2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-3ef6d03e-77dd-4f5e-8859-93432c6c813d req-e2d0d69d-eefc-4ede-b24a-2314af8da33e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Refreshing instance network info cache due to event network-changed-2054724f-4e9d-42cd-ab9d-73c686a7a12d. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3ef6d03e-77dd-4f5e-8859-93432c6c813d req-e2d0d69d-eefc-4ede-b24a-2314af8da33e service nova] Acquiring lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa1317a-94a4-49f0-b41f-6757eaad1587]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAELJHzh {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAELJHzh" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bcb69b-7db8-4cd8-887b-f700cd9e94c9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XAELJHzh'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6574b5ca-f2ce-4088-a99a-f06ea38be7ef]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ec77ee-9eec-407d-a19b-5de71a381162]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:07 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:07 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcafc5d4-55dc-44ae-b4c6-18d08b05e63a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e, portal: 172.16.0.220,3260]
Aug 01 08:11:07 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e, portal: 172.16.0.220,3260] successful.
Aug 01 08:11:07 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[56165e6c-8396-4485-a367-0b8f3b5c3dc8]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2388713-0a9f-4e32-9c26-892d0e6c787c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)
Aug 01 08:11:07 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:07 user nova-compute[72426]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)
Aug 01 08:11:07 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbadb3f-96e9-4152-b670-1bd0bf9060ac]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:11:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAELJHzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.network.neutron [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updating instance_info_cache with network_info: [{"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "address": "fa:16:3e:64:67:5a", "network": {"id": "af3698c2-193b-4a47-86a8-a9fbe39ab2b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1994236515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054724f-4e", "ovs_interfaceid": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Releasing lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3ef6d03e-77dd-4f5e-8859-93432c6c813d req-e2d0d69d-eefc-4ede-b24a-2314af8da33e service nova] Acquired lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.network.neutron [req-3ef6d03e-77dd-4f5e-8859-93432c6c813d req-e2d0d69d-eefc-4ede-b24a-2314af8da33e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Refreshing network info cache for port 2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455569858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455569858',id=9,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUTKnKkZhlWKyb1LXTXXMdqlOlZZJdmZ9D32CohZpgmKqsMway4Q46JX9kgFrLWSVxlSTmjjnXKE3nj8JkoaJvwMhj80lrL96T/qO9KIMTBN0WYaPWA4D1/DHkKIHvFhg==',key_name='tempest-keypair-215514464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:09:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='454252382eb548feadc6ea9d263ced60',ramdisk_id='',reservation_id='r-3s80pq9a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-725575124',owner_user_name='tempest-TaggedAttachmentsTest-725575124-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='641e3764d33b496ca438a15c878f9be2',uuid=9c26ba65-f5a0-499b-9891-c84e1530f40f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "address": "fa:16:3e:64:67:5a", "network": {"id": "af3698c2-193b-4a47-86a8-a9fbe39ab2b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1994236515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054724f-4e", "ovs_interfaceid": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converting VIF {"id": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "address": "fa:16:3e:64:67:5a", "network": {"id": "af3698c2-193b-4a47-86a8-a9fbe39ab2b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1994236515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054724f-4e", "ovs_interfaceid": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:67:5a,bridge_name='br-int',has_traffic_filtering=True,id=2054724f-4e9d-42cd-ab9d-73c686a7a12d,network=Network(af3698c2-193b-4a47-86a8-a9fbe39ab2b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054724f-4e') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG os_vif [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:67:5a,bridge_name='br-int',has_traffic_filtering=True,id=2054724f-4e9d-42cd-ab9d-73c686a7a12d,network=Network(af3698c2-193b-4a47-86a8-a9fbe39ab2b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054724f-4e') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2054724f-4e, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2054724f-4e, col_values=(('external_ids', {'iface-id': '2054724f-4e9d-42cd-ab9d-73c686a7a12d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:67:5a', 'vm-uuid': '9c26ba65-f5a0-499b-9891-c84e1530f40f'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:08 user nova-compute[72426]: INFO os_vif [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:67:5a,bridge_name='br-int',has_traffic_filtering=True,id=2054724f-4e9d-42cd-ab9d-73c686a7a12d,network=Network(af3698c2-193b-4a47-86a8-a9fbe39ab2b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054724f-4e')
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455569858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455569858',id=9,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUTKnKkZhlWKyb1LXTXXMdqlOlZZJdmZ9D32CohZpgmKqsMway4Q46JX9kgFrLWSVxlSTmjjnXKE3nj8JkoaJvwMhj80lrL96T/qO9KIMTBN0WYaPWA4D1/DHkKIHvFhg==',key_name='tempest-keypair-215514464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:09:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='454252382eb548feadc6ea9d263ced60',ramdisk_id='',reservation_id='r-3s80pq9a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-725575124',owner_user_name='tempest-TaggedAttachmentsTest-725575124-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='641e3764d33b496ca438a15c878f9be2',uuid=9c26ba65-f5a0-499b-9891-c84e1530f40f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "address": "fa:16:3e:64:67:5a", "network": {"id": "af3698c2-193b-4a47-86a8-a9fbe39ab2b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1994236515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054724f-4e", "ovs_interfaceid": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converting VIF {"id": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "address": "fa:16:3e:64:67:5a", "network": {"id": "af3698c2-193b-4a47-86a8-a9fbe39ab2b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1994236515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054724f-4e", "ovs_interfaceid": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:67:5a,bridge_name='br-int',has_traffic_filtering=True,id=2054724f-4e9d-42cd-ab9d-73c686a7a12d,network=Network(af3698c2-193b-4a47-86a8-a9fbe39ab2b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054724f-4e') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] attach device xml: <interface type="ethernet">
Aug 01 08:11:08 user nova-compute[72426]:   <mac address="fa:16:3e:64:67:5a"/>
Aug 01 08:11:08 user nova-compute[72426]:   <model type="virtio"/>
Aug 01 08:11:08 user nova-compute[72426]:   <mtu size="1442"/>
Aug 01 08:11:08 user nova-compute[72426]:   <target dev="tap2054724f-4e"/>
Aug 01 08:11:08 user nova-compute[72426]: </interface>
Aug 01 08:11:08 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] No BDM found with device name hda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] No VIF found with MAC fa:16:3e:7e:d4:1c, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:11:08 user nova-compute[72426]:   <nova:package version="0.0.0"/>
Aug 01 08:11:08 user nova-compute[72426]:   <nova:name>tempest-device-tagging-server-1455569858</nova:name>
Aug 01 08:11:08 user nova-compute[72426]:   <nova:creationTime>2023-08-01 08:11:08</nova:creationTime>
Aug 01 08:11:08 user nova-compute[72426]:   <nova:flavor name="m1.tiny">
Aug 01 08:11:08 user nova-compute[72426]:     <nova:memory>512</nova:memory>
Aug 01 08:11:08 user nova-compute[72426]:     <nova:disk>1</nova:disk>
Aug 01 08:11:08 user nova-compute[72426]:     <nova:swap>0</nova:swap>
Aug 01 08:11:08 user nova-compute[72426]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:11:08 user nova-compute[72426]:     <nova:vcpus>1</nova:vcpus>
Aug 01 08:11:08 user nova-compute[72426]:   </nova:flavor>
Aug 01 08:11:08 user nova-compute[72426]:   <nova:owner>
Aug 01 08:11:08 user nova-compute[72426]:     <nova:user uuid="641e3764d33b496ca438a15c878f9be2">tempest-TaggedAttachmentsTest-725575124-project-member</nova:user>
Aug 01 08:11:08 user nova-compute[72426]:     <nova:project uuid="454252382eb548feadc6ea9d263ced60">tempest-TaggedAttachmentsTest-725575124</nova:project>
Aug 01 08:11:08 user nova-compute[72426]:   </nova:owner>
Aug 01 08:11:08 user nova-compute[72426]:   <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:11:08 user nova-compute[72426]:   <nova:ports>
Aug 01 08:11:08 user nova-compute[72426]:     <nova:port uuid="7525e311-6c46-4621-94e5-96940d9e88bd">
Aug 01 08:11:08 user nova-compute[72426]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 08:11:08 user nova-compute[72426]:     </nova:port>
Aug 01 08:11:08 user nova-compute[72426]:     <nova:port uuid="2054724f-4e9d-42cd-ab9d-73c686a7a12d">
Aug 01 08:11:08 user nova-compute[72426]:       <nova:ip type="fixed" address="10.10.10.158" ipVersion="4"/>
Aug 01 08:11:08 user nova-compute[72426]:     </nova:port>
Aug 01 08:11:08 user nova-compute[72426]:   </nova:ports>
Aug 01 08:11:08 user nova-compute[72426]: </nova:instance>
Aug 01 08:11:08 user nova-compute[72426]:  {{(pid=72426) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-23b55bc3-7100-41fc-b8f3-c0ae5b2a1c02 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "interface-9c26ba65-f5a0-499b-9891-c84e1530f40f-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.138s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23930633464393836', 'path': '/dev/sdf'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930633464393836', 'path': '/dev/sdf'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.objects.instance [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lazy-loading 'flavor' on Instance uuid ace240ab-fe78-416a-b45a-85d66b8ac8cd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:11:08 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:11:08 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:11:08 user nova-compute[72426]:   <target dev="sdc" bus="scsi"/>
Aug 01 08:11:08 user nova-compute[72426]:   <serial>584ea139-12fe-4274-9812-ce5bf252a99e</serial>
Aug 01 08:11:08 user nova-compute[72426]:   <address type="drive" controller="0" unit="2"/>
Aug 01 08:11:08 user nova-compute[72426]: </disk>
Aug 01 08:11:08 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG nova.objects.instance [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lazy-loading 'flavor' on Instance uuid 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] No BDM found with device name sda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] No VIF found with MAC fa:16:3e:b6:23:ab, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:09 user nova-compute[72426]: INFO nova.compute.manager [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Attaching volume b344afa6-99e3-42f8-b6d7-42bd617087d3 to /dev/vdb
Aug 01 08:11:09 user nova-compute[72426]: DEBUG os_brick.utils [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1785e0f-4740-4df9-9c86-248178ae3c65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG nova.network.neutron [req-3ef6d03e-77dd-4f5e-8859-93432c6c813d req-e2d0d69d-eefc-4ede-b24a-2314af8da33e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updated VIF entry in instance network info cache for port 2054724f-4e9d-42cd-ab9d-73c686a7a12d. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG nova.network.neutron [req-3ef6d03e-77dd-4f5e-8859-93432c6c813d req-e2d0d69d-eefc-4ede-b24a-2314af8da33e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updating instance_info_cache with network_info: [{"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "address": "fa:16:3e:64:67:5a", "network": {"id": "af3698c2-193b-4a47-86a8-a9fbe39ab2b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1994236515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054724f-4e", "ovs_interfaceid": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3ef6d03e-77dd-4f5e-8859-93432c6c813d req-e2d0d69d-eefc-4ede-b24a-2314af8da33e service nova] Releasing lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28a39e2-cb6d-426a-8e31-f2406acf8016]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da5558-02e2-44bd-a624-30ab31526506]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e82609-5bb8-4c1d-a688-eb3bb213eec0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d6deae82-ea77-4c95-aa92-b7e07e110828 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.727s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-ddcac5bb-188d-415b-b151-0598d43e0909 req-34483758-f129-47aa-80f6-3142e16ee8fa service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-plugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ddcac5bb-188d-415b-b151-0598d43e0909 req-34483758-f129-47aa-80f6-3142e16ee8fa service nova] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ddcac5bb-188d-415b-b151-0598d43e0909 req-34483758-f129-47aa-80f6-3142e16ee8fa service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ddcac5bb-188d-415b-b151-0598d43e0909 req-34483758-f129-47aa-80f6-3142e16ee8fa service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-ddcac5bb-188d-415b-b151-0598d43e0909 req-34483758-f129-47aa-80f6-3142e16ee8fa service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] No waiting events found dispatching network-vif-plugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:09 user nova-compute[72426]: WARNING nova.compute.manager [req-ddcac5bb-188d-415b-b151-0598d43e0909 req-34483758-f129-47aa-80f6-3142e16ee8fa service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received unexpected event network-vif-plugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d for instance with vm_state active and task_state None.
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:11:09 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:11:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2515f5b2-0021-4106-be45-ecc19011182f]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG os_brick.utils [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:09 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updating existing volume attachment record: dae2c110-d940-412b-a931-e2a16897cd5c {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877456.1724606, 7f0c3f3b-a037-4925-8fff-089cc5c5b759 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:11:11 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] VM Stopped (Lifecycle Event)
Aug 01 08:11:11 user nova-compute[72426]: DEBUG nova.compute.manager [None req-12935266-3542-4131-a491-4d51137b01ef None None] [instance: 7f0c3f3b-a037-4925-8fff-089cc5c5b759] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZsyNneg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:11 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:11 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:11 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d04ee1e-f2f3-4869-afb5-cc1bc2b85e8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:11:11 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd40b8e-0375-4f13-a9e5-7a183784e3fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320] added
Aug 01 08:11:11 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07bcaeb-735b-4e69-a037-1ab7d7ab8d27]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[830bc3ac-d326-4dd6-8765-e2181be9ab3d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZsyNneg {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZsyNneg" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd54f5e-a52b-475a-b6ee-8de2d122c450]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZsyNneg'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[735a0ae6-1a32-4847-a76c-863fab9f536e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d82a6d-5aa7-4224-b450-374e3253505a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)
Aug 01 08:11:11 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)
Aug 01 08:11:11 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[db56a363-e175-4f85-8681-f40d726bf12a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320, portal: 172.16.0.220,3260]
Aug 01 08:11:11 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320, portal: 172.16.0.220,3260] successful.
Aug 01 08:11:11 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f5e03f-dedd-4e44-b4ac-89b3c1b552e6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[017d8369-41d6-4076-9dc7-25268127cf23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:11 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)
Aug 01 08:11:11 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:11 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd23a86-ee7f-4a96-8b97-80e49fd57f5b]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZsyNneg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-aa3059dc-23bb-43ee-87c6-f7fb733f7594 req-44ec3839-8f52-4c8f-a1e5-967c06226991 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-plugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-aa3059dc-23bb-43ee-87c6-f7fb733f7594 req-44ec3839-8f52-4c8f-a1e5-967c06226991 service nova] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-aa3059dc-23bb-43ee-87c6-f7fb733f7594 req-44ec3839-8f52-4c8f-a1e5-967c06226991 service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-aa3059dc-23bb-43ee-87c6-f7fb733f7594 req-44ec3839-8f52-4c8f-a1e5-967c06226991 service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-aa3059dc-23bb-43ee-87c6-f7fb733f7594 req-44ec3839-8f52-4c8f-a1e5-967c06226991 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] No waiting events found dispatching network-vif-plugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:11 user nova-compute[72426]: WARNING nova.compute.manager [req-aa3059dc-23bb-43ee-87c6-f7fb733f7594 req-44ec3839-8f52-4c8f-a1e5-967c06226991 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received unexpected event network-vif-plugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d for instance with vm_state active and task_state None.
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:11 user nova-compute[72426]: INFO nova.compute.manager [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Detaching volume 584ea139-12fe-4274-9812-ce5bf252a99e
Aug 01 08:11:12 user nova-compute[72426]: INFO nova.virt.block_device [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Attempting to driver detach volume 584ea139-12fe-4274-9812-ce5bf252a99e from mountpoint /dev/sdc
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Attempting to detach device sdc from instance ace240ab-fe78-416a-b45a-85d66b8ac8cd from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:11:12 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:11:12 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:11:12 user nova-compute[72426]:   <target dev="sdc" bus="scsi"/>
Aug 01 08:11:12 user nova-compute[72426]:   <serial>584ea139-12fe-4274-9812-ce5bf252a99e</serial>
Aug 01 08:11:12 user nova-compute[72426]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 08:11:12 user nova-compute[72426]: </disk>
Aug 01 08:11:12 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:11:12 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Successfully detached device sdc from instance ace240ab-fe78-416a-b45a-85d66b8ac8cd from the persistent domain config.
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ace240ab-fe78-416a-b45a-85d66b8ac8cd from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:11:12 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:11:12 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:11:12 user nova-compute[72426]:   <target dev="sdc" bus="scsi"/>
Aug 01 08:11:12 user nova-compute[72426]:   <serial>584ea139-12fe-4274-9812-ce5bf252a99e</serial>
Aug 01 08:11:12 user nova-compute[72426]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 08:11:12 user nova-compute[72426]: </disk>
Aug 01 08:11:12 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690877472.463397, ace240ab-fe78-416a-b45a-85d66b8ac8cd => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ace240ab-fe78-416a-b45a-85d66b8ac8cd {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:11:12 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Successfully detached device sdc from instance ace240ab-fe78-416a-b45a-85d66b8ac8cd from the live domain config.
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAELJHzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:12 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26631653366353831', 'path': '/dev/sdg'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631653366353831', 'path': '/dev/sdg'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.280s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lazy-loading 'flavor' on Instance uuid f826ffe7-92dc-4f05-9298-1236513a1af2 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5162c79f-ffd6-4f26-a88a-b304e57ac39e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:11:12 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:11:12 user nova-compute[72426]:   <source dev="/dev/sdg"/>
Aug 01 08:11:12 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:11:12 user nova-compute[72426]:   <serial>fc631164-acbf-4ad5-a948-f02ccf95e320</serial>
Aug 01 08:11:12 user nova-compute[72426]: </disk>
Aug 01 08:11:12 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66fc865-3a9e-418f-994e-231d8276e097]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:12 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:12 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:12 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:12 user nova-compute[72426]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)
Aug 01 08:11:12 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:12 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:12 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:12 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:12 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:12 user nova-compute[72426]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e (non-flash)
Aug 01 08:11:12 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:12 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c3aa3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e'): ({'sdf'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Removing single pathed devices sdf {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b8051c-e174-4e71-99a6-fbcdfa1382b8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXzFsygH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:12 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d782f0bd-31cd-4bd9-96e0-fe87b430e26c]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Flushing IO for device /dev/sdf {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d853e632-3c48-4398-a1d7-7ec26e2bb299]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6d488e-6671-48ab-aa04-7e01e2e4eb2a]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f2ba76-4503-4d76-9065-76f668f1f210]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[160f17a4-390f-4c5a-837d-0c226ed87734]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e, portal: 172.16.0.220,3260]
Aug 01 08:11:13 user nova-compute[72426]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e, portal: 172.16.0.220,3260] successful.
Aug 01 08:11:13 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584ea139-12fe-4274-9812-ce5bf252a99e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c87ef2-4788-458e-9626-5d0881c23ff5]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] <== disconnect_volume: return (590ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.233s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:13 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:13 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc38bddb-81db-4072-ac37-18a695f5b158]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:11:13 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baef6af-caef-47a7-a9c2-830c10628761]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee] added
Aug 01 08:11:13 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b02f888-5041-4c97-801c-bcb5f9dc923e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c74a694-e786-49b5-8593-5ad060e3094f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXzFsygH {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] No VIF found with MAC fa:16:3e:c4:2d:40, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXzFsygH" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c74ac2-6572-4b88-a68e-0b11542169c6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BXzFsygH'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bd24ec-910d-4040-9ef9-7783230f6f5e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de9284-207c-4814-9830-be34093e881a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:13 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:13 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e60ec71d-d11a-413f-939b-8b88242ef515 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.368s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3fc590-1bc8-40f4-9d4d-e943d6f0bcc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee, portal: 172.16.0.220,3260]
Aug 01 08:11:13 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee, portal: 172.16.0.220,3260] successful.
Aug 01 08:11:13 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[48df60ea-3dfc-4f92-82e0-65a2ae9c47d3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d52b9c-0ef0-4ba7-a8e8-21efa7c9f5a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)
Aug 01 08:11:13 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:13 user nova-compute[72426]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)
Aug 01 08:11:13 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e47cde8-7f3d-4d31-a97c-33ee8c073328]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:11:13 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXzFsygH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG os_brick.utils [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab148838-5756-4fb1-938f-2675d22dd13c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf6e68a-d869-47a9-a0d9-9ae556499eb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a7bc61-d697-429e-997b-9830abfa37cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20e3fc6-6530-4de1-ac42-c2dfe39e4816]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] <== connect_volume: return (1592ms) {'type': 'block', 'scsi_wwn': '23031313761303263', 'path': '/dev/sdf'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031313761303263', 'path': '/dev/sdf'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG nova.objects.instance [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lazy-loading 'flavor' on Instance uuid 457df7dd-4e0f-4d72-915b-644f0c8588eb {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:11:14 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:11:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc1042d-8114-41aa-b56c-f6516aabd8a2]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG os_brick.utils [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:11:14 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:11:14 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:11:14 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:11:14 user nova-compute[72426]:   <serial>51aee390-ff74-4fa5-a068-0cd93c4a7bee</serial>
Aug 01 08:11:14 user nova-compute[72426]: </disk>
Aug 01 08:11:14 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:11:14 user nova-compute[72426]: INFO nova.compute.manager [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Swapping volume fc631164-acbf-4ad5-a948-f02ccf95e320 for 3eaf0996-621b-40f6-8ac3-d255de6c71c8
Aug 01 08:11:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] No VIF found with MAC fa:16:3e:db:1c:0b, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:11:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:20 user nova-compute[72426]: DEBUG nova.objects.instance [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lazy-loading 'flavor' on Instance uuid ace240ab-fe78-416a-b45a-85d66b8ac8cd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-510c1981-c43d-4dd1-9ad5-574bbcee3b77 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.062s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b34fd7-b087-4be8-bea7-79b5dbc6ba3e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.984s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSIVxgKB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:21 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:21 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:21 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7396df2-1e73-481f-b112-001b4e141501]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:11:21 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac52049-e899-4d80-8221-c24109588a80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3] added
Aug 01 08:11:21 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3f716-3af2-4848-956d-c96c83c5b1b2]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5d4d91-7f49-4079-8476-54dd2f7d72a7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OSIVxgKB {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.volume.cinder [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] Update attachment failed for attachment 6c9c33d6-e02f-47fb-bf37-9f5e3bdc7cfe. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-2d7e44a6-fd63-4ab1-a197-9d08834f4a39) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-2d7e44a6-fd63-4ab1-a197-9d08834f4a39)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Failed to connect to volume 3eaf0996-621b-40f6-8ac3-d255de6c71c8 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-2d7e44a6-fd63-4ab1-a197-9d08834f4a39)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Traceback (most recent call last):
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     new_cinfo = self.volume_api.attachment_update(
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     res = method(self, ctx, *args, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     with excutils.save_and_reraise_exception():
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     self.force_reraise()
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     raise self.value
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     context, '3.44', skip_version_check=True).attachments.update(
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     return method.func(obj, *args, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     resp = self._update('/attachments/%s' % id, body)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     return self._cs_request(url, 'PUT', **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     return self.request(url, method, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2]     raise exceptions.from_response(resp, body)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-2d7e44a6-fd63-4ab1-a197-9d08834f4a39)
Aug 01 08:11:21 user nova-compute[72426]: ERROR nova.compute.manager [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] 
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OSIVxgKB" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b1ef5b-be42-4b38-ba57-6226fba37b32]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OSIVxgKB'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daea29c-e57c-4bd9-9163-3b494d2afbd8]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ccb61-8aa9-4eed-89b6-e22ce956764b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)
Aug 01 08:11:21 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)
Aug 01 08:11:21 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[827dbbd7-1f7d-441e-866f-d5fa32f55e24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3, portal: 172.16.0.220,3260]
Aug 01 08:11:21 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3, portal: 172.16.0.220,3260] successful.
Aug 01 08:11:21 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[52329873-4f8e-44bd-be70-ab08f9684d28]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 7.156s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[902fffdd-cbf7-46f3-86d5-78b6765ad2e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)
Aug 01 08:11:21 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:21 user nova-compute[72426]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)
Aug 01 08:11:21 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c5afba-1d74-4461-9d86-1a4621609e18]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSIVxgKB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server [None req-993f6876-7317-4eac-8b9b-c587c8cb1a29 tempest-TestVolumeSwap-1052298994 tempest-TestVolumeSwap-1052298994-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-2d7e44a6-fd63-4ab1-a197-9d08834f4a39)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7823, in swap_volume
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7821, in _do_locked_swap_volume
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7865, in _do_swap_volume
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7714, in _swap_volume
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:3eaf0996-621b-40f6-8ac3-d255de6c71c8/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-2d7e44a6-fd63-4ab1-a197-9d08834f4a39)
Aug 01 08:11:21 user nova-compute[72426]: ERROR oslo_messaging.rpc.server 
Aug 01 08:11:21 user nova-compute[72426]: INFO nova.compute.manager [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Terminating instance
Aug 01 08:11:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-45ffd4aa-d6f1-4bb0-ac92-dbb7435f6b33 req-ae948dc0-d4ba-4407-ac77-2344b55ee5ba service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received event network-vif-unplugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-45ffd4aa-d6f1-4bb0-ac92-dbb7435f6b33 req-ae948dc0-d4ba-4407-ac77-2344b55ee5ba service nova] Acquiring lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-45ffd4aa-d6f1-4bb0-ac92-dbb7435f6b33 req-ae948dc0-d4ba-4407-ac77-2344b55ee5ba service nova] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-45ffd4aa-d6f1-4bb0-ac92-dbb7435f6b33 req-ae948dc0-d4ba-4407-ac77-2344b55ee5ba service nova] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-45ffd4aa-d6f1-4bb0-ac92-dbb7435f6b33 req-ae948dc0-d4ba-4407-ac77-2344b55ee5ba service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] No waiting events found dispatching network-vif-unplugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-45ffd4aa-d6f1-4bb0-ac92-dbb7435f6b33 req-ae948dc0-d4ba-4407-ac77-2344b55ee5ba service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received event network-vif-unplugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:22 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Instance destroyed successfully.
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lazy-loading 'resources' on Instance uuid ace240ab-fe78-416a-b45a-85d66b8ac8cd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-13021962',display_name='tempest-AttachSCSIVolumeTestJSON-server-13021962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-13021962',id=7,image_ref='44c8042a-57ee-454c-a5a9-1c5969bcf383',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaX1n3rfb0jmRqvPU29SmMdHegN2dCtlvmCVdoUgEv82Mnvh3BDJwB5/4dY0RlHCWCM4i3NBf0hkDWZsD6MqOvVJeFQwtH1WOKdXs6TptgI/cJ53CiF7fqNqvK47KZVTA==',key_name='tempest-keypair-2061250495',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:09:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e658a8f757ae427b98330de9ce86291a',ramdisk_id='',reservation_id='r-082vhmkb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='44c8042a-57ee-454c-a5a9-1c5969bcf383',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-130105759',owner_user_name='tempest-AttachSCSIVolumeTestJSON-130105759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60c058782355441c897d7677a79abfa1',uuid=ace240ab-fe78-416a-b45a-85d66b8ac8cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Converting VIF {"id": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "address": "fa:16:3e:b6:23:ab", "network": {"id": "00f4371d-adfc-4a86-ab2b-ea48dcd03258", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-857724809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e658a8f757ae427b98330de9ce86291a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5f921a-9e", "ovs_interfaceid": "aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:23:ab,bridge_name='br-int',has_traffic_filtering=True,id=aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4,network=Network(00f4371d-adfc-4a86-ab2b-ea48dcd03258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5f921a-9e') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG os_vif [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:23:ab,bridge_name='br-int',has_traffic_filtering=True,id=aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4,network=Network(00f4371d-adfc-4a86-ab2b-ea48dcd03258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5f921a-9e') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa5f921a-9e, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:22 user nova-compute[72426]: INFO os_vif [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:23:ab,bridge_name='br-int',has_traffic_filtering=True,id=aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4,network=Network(00f4371d-adfc-4a86-ab2b-ea48dcd03258),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5f921a-9e')
Aug 01 08:11:22 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Deleting instance files /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd_del
Aug 01 08:11:22 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Deletion of /opt/stack/data/nova/instances/ace240ab-fe78-416a-b45a-85d66b8ac8cd_del complete
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26263656362613233', 'path': '/dev/sdh'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263656362613233', 'path': '/dev/sdh'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lazy-loading 'flavor' on Instance uuid 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:22 user nova-compute[72426]: INFO nova.compute.manager [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:11:22 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:11:22 user nova-compute[72426]:   <source dev="/dev/sdh"/>
Aug 01 08:11:22 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:11:22 user nova-compute[72426]:   <serial>b344afa6-99e3-42f8-b6d7-42bd617087d3</serial>
Aug 01 08:11:22 user nova-compute[72426]: </disk>
Aug 01 08:11:22 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:22 user nova-compute[72426]: INFO nova.compute.manager [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Detaching volume 51aee390-ff74-4fa5-a068-0cd93c4a7bee
Aug 01 08:11:22 user nova-compute[72426]: INFO nova.virt.block_device [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Attempting to driver detach volume 51aee390-ff74-4fa5-a068-0cd93c4a7bee from mountpoint /dev/vdb
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Attempting to detach device vdb from instance 457df7dd-4e0f-4d72-915b-644f0c8588eb from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:11:22 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:11:22 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:11:22 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:11:22 user nova-compute[72426]:   <serial>51aee390-ff74-4fa5-a068-0cd93c4a7bee</serial>
Aug 01 08:11:22 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:11:22 user nova-compute[72426]: </disk>
Aug 01 08:11:22 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:11:22 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Successfully detached device vdb from instance 457df7dd-4e0f-4d72-915b-644f0c8588eb from the persistent domain config.
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 457df7dd-4e0f-4d72-915b-644f0c8588eb from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:11:22 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:11:22 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:11:22 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:11:22 user nova-compute[72426]:   <serial>51aee390-ff74-4fa5-a068-0cd93c4a7bee</serial>
Aug 01 08:11:22 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:11:22 user nova-compute[72426]: </disk>
Aug 01 08:11:22 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:11:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] No BDM found with device name hda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] No VIF found with MAC fa:16:3e:7e:d4:1c, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5db013f0-5027-49a3-9385-81940eae909c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.745s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690877483.3725226, 457df7dd-4e0f-4d72-915b-644f0c8588eb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 457df7dd-4e0f-4d72-915b-644f0c8588eb {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:11:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Successfully detached device vdb from instance 457df7dd-4e0f-4d72-915b-644f0c8588eb from the live domain config.
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXzFsygH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:23 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c5f3a0-0209-4edf-88f0-522a54f67eec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[30977c3c-1c59-463e-8d40-2d06d18a1501]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)
Aug 01 08:11:23 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:23 user nova-compute[72426]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee (non-flash)
Aug 01 08:11:23 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c8b8b9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee'): ({'sdf'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Removing single pathed devices sdf {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4942d01-ff20-4012-b3d2-55d3c285c52f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce27eda-2698-42fb-b7b6-7b446f732a33]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Flushing IO for device /dev/sdf {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a158bc-1c3a-4cb8-9e14-a08c74adfc29]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5cde92-a19b-469b-8c4c-5ba6c05ff493]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6689bc-b30a-4820-9dd0-6219d48c129b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b066b67-ea3e-42ef-bb16-f6e14807f217]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-f22dcb81-86a7-4595-b6b5-b682e055aea8 req-a286f1ed-ce04-4532-b527-a4bb9f092a05 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received event network-vif-deleted-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:23 user nova-compute[72426]: INFO nova.compute.manager [req-f22dcb81-86a7-4595-b6b5-b682e055aea8 req-a286f1ed-ce04-4532-b527-a4bb9f092a05 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Neutron deleted interface aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4; detaching it from the instance and deleting it from the info cache
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.network.neutron [req-f22dcb81-86a7-4595-b6b5-b682e055aea8 req-a286f1ed-ce04-4532-b527-a4bb9f092a05 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee, portal: 172.16.0.220,3260]
Aug 01 08:11:23 user nova-compute[72426]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee, portal: 172.16.0.220,3260] successful.
Aug 01 08:11:23 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Took 1.16 seconds to deallocate network for instance.
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-f22dcb81-86a7-4595-b6b5-b682e055aea8 req-a286f1ed-ce04-4532-b527-a4bb9f092a05 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Detach interface failed, port_id=aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4, reason: Instance ace240ab-fe78-416a-b45a-85d66b8ac8cd could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51aee390-ff74-4fa5-a068-0cd93c4a7bee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81b0a04-6e34-4c93-97bf-367ce4b5fbcf]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] <== disconnect_volume: return (374ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:11:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-cdf0c917-3f5f-4a1a-b414-1f8b45010334 req-3d398761-7077-40c1-95b1-a67b1989c2d3 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received event network-vif-plugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cdf0c917-3f5f-4a1a-b414-1f8b45010334 req-3d398761-7077-40c1-95b1-a67b1989c2d3 service nova] Acquiring lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cdf0c917-3f5f-4a1a-b414-1f8b45010334 req-3d398761-7077-40c1-95b1-a67b1989c2d3 service nova] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cdf0c917-3f5f-4a1a-b414-1f8b45010334 req-3d398761-7077-40c1-95b1-a67b1989c2d3 service nova] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-cdf0c917-3f5f-4a1a-b414-1f8b45010334 req-3d398761-7077-40c1-95b1-a67b1989c2d3 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] No waiting events found dispatching network-vif-plugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:24 user nova-compute[72426]: WARNING nova.compute.manager [req-cdf0c917-3f5f-4a1a-b414-1f8b45010334 req-3d398761-7077-40c1-95b1-a67b1989c2d3 service nova] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Received unexpected event network-vif-plugged-aa5f921a-9e68-4cdd-95e0-b5ab0ecb85f4 for instance with vm_state deleted and task_state None.
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:24 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Deleted allocations for instance ace240ab-fe78-416a-b45a-85d66b8ac8cd
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.objects.instance [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lazy-loading 'flavor' on Instance uuid 457df7dd-4e0f-4d72-915b-644f0c8588eb {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e058f8ac-3565-4a61-b5a2-b42cf81336f0 tempest-AttachSCSIVolumeTestJSON-130105759 tempest-AttachSCSIVolumeTestJSON-130105759-project-member] Lock "ace240ab-fe78-416a-b45a-85d66b8ac8cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.289s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:24 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:11:24 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7329MB free_disk=25.821731567382812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6b46544c-b631-4733-9fcd-a61cd61886c1 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.129s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 457df7dd-4e0f-4d72-915b-644f0c8588eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance f826ffe7-92dc-4f05-9298-1236513a1af2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 9c26ba65-f5a0-499b-9891-c84e1530f40f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance aae9f4f0-aeda-4008-aaf7-0bc42fa24be4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 26f6d35a-d2e0-4ec3-b482-4d66593d0207 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:11:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:25 user nova-compute[72426]: INFO nova.compute.manager [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Detaching volume b344afa6-99e3-42f8-b6d7-42bd617087d3
Aug 01 08:11:25 user nova-compute[72426]: INFO nova.virt.block_device [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Attempting to driver detach volume b344afa6-99e3-42f8-b6d7-42bd617087d3 from mountpoint /dev/vdb
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Attempting to detach device vdb from instance 9c26ba65-f5a0-499b-9891-c84e1530f40f from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:11:25 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:11:25 user nova-compute[72426]:   <source dev="/dev/sdh"/>
Aug 01 08:11:25 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:11:25 user nova-compute[72426]:   <serial>b344afa6-99e3-42f8-b6d7-42bd617087d3</serial>
Aug 01 08:11:25 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 08:11:25 user nova-compute[72426]: </disk>
Aug 01 08:11:25 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:11:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Successfully detached device vdb from instance 9c26ba65-f5a0-499b-9891-c84e1530f40f from the persistent domain config.
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c26ba65-f5a0-499b-9891-c84e1530f40f from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:11:25 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:11:25 user nova-compute[72426]:   <source dev="/dev/sdh"/>
Aug 01 08:11:25 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:11:25 user nova-compute[72426]:   <serial>b344afa6-99e3-42f8-b6d7-42bd617087d3</serial>
Aug 01 08:11:25 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 08:11:25 user nova-compute[72426]: </disk>
Aug 01 08:11:25 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690877485.5900328, 9c26ba65-f5a0-499b-9891-c84e1530f40f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:11:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Successfully detached device vdb from instance 9c26ba65-f5a0-499b-9891-c84e1530f40f from the live domain config.
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OSIVxgKB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:25 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad38faee-143c-4a8f-aab9-91d36844b843]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe283cf5-8317-46c1-b7f5-1350bf494596]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 (non-flash)
Aug 01 08:11:25 user nova-compute[72426]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:25 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:25 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:25 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:25 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:25 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 (non-flash)
Aug 01 08:11:25 user nova-compute[72426]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:25 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:25 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:25 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:25 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:25 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c3a9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3'): ({'sdh'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Removing single pathed devices sdh {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbcd919-88b8-487e-b36b-8fd1b05daca5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[30daa1d9-8467-473b-968f-8d5ab06a09f8]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Flushing IO for device /dev/sdh {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedb86e1-824d-45af-820e-0ce6d5e0d25a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.061s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94f2a63-d84a-446f-aa4b-9a76d06b0dbe]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] SCSI volumes sdh have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a5a535-7043-4ae2-9255-9b9237cc6377]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f0fd21-51e2-4962-8778-984ab085ef42]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3, portal: 172.16.0.220,3260]
Aug 01 08:11:25 user nova-compute[72426]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3, portal: 172.16.0.220,3260] successful.
Aug 01 08:11:25 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b344afa6-99e3-42f8-b6d7-42bd617087d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[576889de-91da-40f5-ab62-6694745937eb]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] <== disconnect_volume: return (303ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lazy-loading 'flavor' on Instance uuid 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e55c4237-c68c-4b00-8a05-ddf2abf526c7 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updating instance_info_cache with network_info: [{"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:11:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "interface-9c26ba65-f5a0-499b-9891-c84e1530f40f-2054724f-4e9d-42cd-ab9d-73c686a7a12d" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "interface-9c26ba65-f5a0-499b-9891-c84e1530f40f-2054724f-4e9d-42cd-ab9d-73c686a7a12d" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.objects.instance [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lazy-loading 'flavor' on Instance uuid 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455569858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455569858',id=9,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUTKnKkZhlWKyb1LXTXXMdqlOlZZJdmZ9D32CohZpgmKqsMway4Q46JX9kgFrLWSVxlSTmjjnXKE3nj8JkoaJvwMhj80lrL96T/qO9KIMTBN0WYaPWA4D1/DHkKIHvFhg==',key_name='tempest-keypair-215514464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:09:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='454252382eb548feadc6ea9d263ced60',ramdisk_id='',reservation_id='r-3s80pq9a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-725575124',owner_user_name='tempest-TaggedAttachmentsTest-725575124-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='641e3764d33b496ca438a15c878f9be2',uuid=9c26ba65-f5a0-499b-9891-c84e1530f40f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "address": "fa:16:3e:64:67:5a", "network": {"id": "af3698c2-193b-4a47-86a8-a9fbe39ab2b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1994236515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054724f-4e", "ovs_interfaceid": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converting VIF {"id": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "address": "fa:16:3e:64:67:5a", "network": {"id": "af3698c2-193b-4a47-86a8-a9fbe39ab2b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1994236515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054724f-4e", "ovs_interfaceid": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:67:5a,bridge_name='br-int',has_traffic_filtering=True,id=2054724f-4e9d-42cd-ab9d-73c686a7a12d,network=Network(af3698c2-193b-4a47-86a8-a9fbe39ab2b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054724f-4e') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:67:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2054724f-4e"/></interface> {{(pid=72426) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:67:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2054724f-4e"/></interface> {{(pid=72426) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Attempting to detach device tap2054724f-4e from instance 9c26ba65-f5a0-499b-9891-c84e1530f40f from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] detach device xml: <interface type="ethernet">
Aug 01 08:11:27 user nova-compute[72426]:   <mac address="fa:16:3e:64:67:5a"/>
Aug 01 08:11:27 user nova-compute[72426]:   <model type="virtio"/>
Aug 01 08:11:27 user nova-compute[72426]:   <mtu size="1442"/>
Aug 01 08:11:27 user nova-compute[72426]:   <target dev="tap2054724f-4e"/>
Aug 01 08:11:27 user nova-compute[72426]: </interface>
Aug 01 08:11:27 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:67:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2054724f-4e"/></interface> {{(pid=72426) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:64:67:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2054724f-4e"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 01 08:11:27 user nova-compute[72426]:   <name>instance-00000009</name>
Aug 01 08:11:27 user nova-compute[72426]:   <uuid>9c26ba65-f5a0-499b-9891-c84e1530f40f</uuid>
Aug 01 08:11:27 user nova-compute[72426]:   <metadata>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:11:27 user nova-compute[72426]:   <nova:package version="0.0.0"/>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:name>tempest-device-tagging-server-1455569858</nova:name>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:creationTime>2023-08-01 08:11:08</nova:creationTime>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:flavor name="m1.tiny">
Aug 01 08:11:27 user nova-compute[72426]:     <nova:memory>512</nova:memory>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:disk>1</nova:disk>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:swap>0</nova:swap>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:vcpus>1</nova:vcpus>
Aug 01 08:11:27 user nova-compute[72426]:   </nova:flavor>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:owner>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:user uuid="641e3764d33b496ca438a15c878f9be2">tempest-TaggedAttachmentsTest-725575124-project-member</nova:user>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:project uuid="454252382eb548feadc6ea9d263ced60">tempest-TaggedAttachmentsTest-725575124</nova:project>
Aug 01 08:11:27 user nova-compute[72426]:   </nova:owner>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:ports>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:port uuid="7525e311-6c46-4621-94e5-96940d9e88bd">
Aug 01 08:11:27 user nova-compute[72426]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 08:11:27 user nova-compute[72426]:     </nova:port>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:port uuid="2054724f-4e9d-42cd-ab9d-73c686a7a12d">
Aug 01 08:11:27 user nova-compute[72426]:       <nova:ip type="fixed" address="10.10.10.158" ipVersion="4"/>
Aug 01 08:11:27 user nova-compute[72426]:     </nova:port>
Aug 01 08:11:27 user nova-compute[72426]:   </nova:ports>
Aug 01 08:11:27 user nova-compute[72426]: </nova:instance>
Aug 01 08:11:27 user nova-compute[72426]:   </metadata>
Aug 01 08:11:27 user nova-compute[72426]:   <memory unit='KiB'>524288</memory>
Aug 01 08:11:27 user nova-compute[72426]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 08:11:27 user nova-compute[72426]:   <vcpu placement='static'>1</vcpu>
Aug 01 08:11:27 user nova-compute[72426]:   <resource>
Aug 01 08:11:27 user nova-compute[72426]:     <partition>/machine</partition>
Aug 01 08:11:27 user nova-compute[72426]:   </resource>
Aug 01 08:11:27 user nova-compute[72426]:   <sysinfo type='smbios'>
Aug 01 08:11:27 user nova-compute[72426]:     <system>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='version'>0.0.0</entry>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='serial'>9c26ba65-f5a0-499b-9891-c84e1530f40f</entry>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='uuid'>9c26ba65-f5a0-499b-9891-c84e1530f40f</entry>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='family'>Virtual Machine</entry>
Aug 01 08:11:27 user nova-compute[72426]:     </system>
Aug 01 08:11:27 user nova-compute[72426]:   </sysinfo>
Aug 01 08:11:27 user nova-compute[72426]:   <os>
Aug 01 08:11:27 user nova-compute[72426]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 08:11:27 user nova-compute[72426]:     <boot dev='hd'/>
Aug 01 08:11:27 user nova-compute[72426]:     <smbios mode='sysinfo'/>
Aug 01 08:11:27 user nova-compute[72426]:   </os>
Aug 01 08:11:27 user nova-compute[72426]:   <features>
Aug 01 08:11:27 user nova-compute[72426]:     <acpi/>
Aug 01 08:11:27 user nova-compute[72426]:     <apic/>
Aug 01 08:11:27 user nova-compute[72426]:     <vmcoreinfo state='on'/>
Aug 01 08:11:27 user nova-compute[72426]:   </features>
Aug 01 08:11:27 user nova-compute[72426]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 08:11:27 user nova-compute[72426]:     <model fallback='forbid'>Nehalem</model>
Aug 01 08:11:27 user nova-compute[72426]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 08:11:27 user nova-compute[72426]:     <feature policy='require' name='vme'/>
Aug 01 08:11:27 user nova-compute[72426]:     <feature policy='require' name='x2apic'/>
Aug 01 08:11:27 user nova-compute[72426]:     <feature policy='require' name='hypervisor'/>
Aug 01 08:11:27 user nova-compute[72426]:   </cpu>
Aug 01 08:11:27 user nova-compute[72426]:   <clock offset='utc'>
Aug 01 08:11:27 user nova-compute[72426]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 08:11:27 user nova-compute[72426]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 08:11:27 user nova-compute[72426]:     <timer name='hpet' present='no'/>
Aug 01 08:11:27 user nova-compute[72426]:   </clock>
Aug 01 08:11:27 user nova-compute[72426]:   <on_poweroff>destroy</on_poweroff>
Aug 01 08:11:27 user nova-compute[72426]:   <on_reboot>restart</on_reboot>
Aug 01 08:11:27 user nova-compute[72426]:   <on_crash>destroy</on_crash>
Aug 01 08:11:27 user nova-compute[72426]:   <devices>
Aug 01 08:11:27 user nova-compute[72426]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 08:11:27 user nova-compute[72426]:     <disk type='file' device='disk'>
Aug 01 08:11:27 user nova-compute[72426]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 08:11:27 user nova-compute[72426]:       <source file='/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk' index='2'/>
Aug 01 08:11:27 user nova-compute[72426]:       <backingStore type='file' index='3'>
Aug 01 08:11:27 user nova-compute[72426]:         <format type='raw'/>
Aug 01 08:11:27 user nova-compute[72426]:         <source file='/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9'/>
Aug 01 08:11:27 user nova-compute[72426]:         <backingStore/>
Aug 01 08:11:27 user nova-compute[72426]:       </backingStore>
Aug 01 08:11:27 user nova-compute[72426]:       <target dev='vda' bus='virtio'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='virtio-disk0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </disk>
Aug 01 08:11:27 user nova-compute[72426]:     <disk type='file' device='cdrom'>
Aug 01 08:11:27 user nova-compute[72426]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 08:11:27 user nova-compute[72426]:       <source file='/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk.config' index='1'/>
Aug 01 08:11:27 user nova-compute[72426]:       <backingStore/>
Aug 01 08:11:27 user nova-compute[72426]:       <target dev='hda' bus='ide'/>
Aug 01 08:11:27 user nova-compute[72426]:       <readonly/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='ide0-0-0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </disk>
Aug 01 08:11:27 user nova-compute[72426]:     <controller type='usb' index='0' model='none'>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='usb'/>
Aug 01 08:11:27 user nova-compute[72426]:     </controller>
Aug 01 08:11:27 user nova-compute[72426]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='pci.0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </controller>
Aug 01 08:11:27 user nova-compute[72426]:     <controller type='ide' index='0'>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='ide'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 08:11:27 user nova-compute[72426]:     </controller>
Aug 01 08:11:27 user nova-compute[72426]:     <interface type='ethernet'>
Aug 01 08:11:27 user nova-compute[72426]:       <mac address='fa:16:3e:7e:d4:1c'/>
Aug 01 08:11:27 user nova-compute[72426]:       <target dev='tap7525e311-6c'/>
Aug 01 08:11:27 user nova-compute[72426]:       <model type='virtio'/>
Aug 01 08:11:27 user nova-compute[72426]:       <mtu size='1442'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='net0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </interface>
Aug 01 08:11:27 user nova-compute[72426]:     <interface type='ethernet'>
Aug 01 08:11:27 user nova-compute[72426]:       <mac address='fa:16:3e:64:67:5a'/>
Aug 01 08:11:27 user nova-compute[72426]:       <target dev='tap2054724f-4e'/>
Aug 01 08:11:27 user nova-compute[72426]:       <model type='virtio'/>
Aug 01 08:11:27 user nova-compute[72426]:       <mtu size='1442'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='net1'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </interface>
Aug 01 08:11:27 user nova-compute[72426]:     <serial type='pty'>
Aug 01 08:11:27 user nova-compute[72426]:       <source path='/dev/pts/8'/>
Aug 01 08:11:27 user nova-compute[72426]:       <log file='/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/console.log' append='off'/>
Aug 01 08:11:27 user nova-compute[72426]:       <target type='isa-serial' port='0'>
Aug 01 08:11:27 user nova-compute[72426]:         <model name='isa-serial'/>
Aug 01 08:11:27 user nova-compute[72426]:       </target>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='serial0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </serial>
Aug 01 08:11:27 user nova-compute[72426]:     <console type='pty' tty='/dev/pts/8'>
Aug 01 08:11:27 user nova-compute[72426]:       <source path='/dev/pts/8'/>
Aug 01 08:11:27 user nova-compute[72426]:       <log file='/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/console.log' append='off'/>
Aug 01 08:11:27 user nova-compute[72426]:       <target type='serial' port='0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='serial0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </console>
Aug 01 08:11:27 user nova-compute[72426]:     <input type='mouse' bus='ps2'>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='input0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </input>
Aug 01 08:11:27 user nova-compute[72426]:     <input type='keyboard' bus='ps2'>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='input1'/>
Aug 01 08:11:27 user nova-compute[72426]:     </input>
Aug 01 08:11:27 user nova-compute[72426]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 01 08:11:27 user nova-compute[72426]:       <listen type='address' address='0.0.0.0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </graphics>
Aug 01 08:11:27 user nova-compute[72426]:     <audio id='1' type='none'/>
Aug 01 08:11:27 user nova-compute[72426]:     <video>
Aug 01 08:11:27 user nova-compute[72426]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='video0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </video>
Aug 01 08:11:27 user nova-compute[72426]:     <memballoon model='virtio'>
Aug 01 08:11:27 user nova-compute[72426]:       <stats period='10'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='balloon0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </memballoon>
Aug 01 08:11:27 user nova-compute[72426]:     <rng model='virtio'>
Aug 01 08:11:27 user nova-compute[72426]:       <backend model='random'>/dev/urandom</backend>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='rng0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </rng>
Aug 01 08:11:27 user nova-compute[72426]:   </devices>
Aug 01 08:11:27 user nova-compute[72426]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 08:11:27 user nova-compute[72426]:     <label>libvirt-9c26ba65-f5a0-499b-9891-c84e1530f40f</label>
Aug 01 08:11:27 user nova-compute[72426]:     <imagelabel>libvirt-9c26ba65-f5a0-499b-9891-c84e1530f40f</imagelabel>
Aug 01 08:11:27 user nova-compute[72426]:   </seclabel>
Aug 01 08:11:27 user nova-compute[72426]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 08:11:27 user nova-compute[72426]:     <label>+64055:+108</label>
Aug 01 08:11:27 user nova-compute[72426]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 08:11:27 user nova-compute[72426]:   </seclabel>
Aug 01 08:11:27 user nova-compute[72426]: </domain>
Aug 01 08:11:27 user nova-compute[72426]:  {{(pid=72426) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 08:11:27 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Successfully detached device tap2054724f-4e from instance 9c26ba65-f5a0-499b-9891-c84e1530f40f from the persistent domain config.
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] (1/8): Attempting to detach device tap2054724f-4e with device alias net1 from instance 9c26ba65-f5a0-499b-9891-c84e1530f40f from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] detach device xml: <interface type="ethernet">
Aug 01 08:11:27 user nova-compute[72426]:   <mac address="fa:16:3e:64:67:5a"/>
Aug 01 08:11:27 user nova-compute[72426]:   <model type="virtio"/>
Aug 01 08:11:27 user nova-compute[72426]:   <mtu size="1442"/>
Aug 01 08:11:27 user nova-compute[72426]:   <target dev="tap2054724f-4e"/>
Aug 01 08:11:27 user nova-compute[72426]: </interface>
Aug 01 08:11:27 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690877487.6340833, 9c26ba65-f5a0-499b-9891-c84e1530f40f => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Start waiting for the detach event from libvirt for device tap2054724f-4e with device alias net1 for instance 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:64:67:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2054724f-4e"/></interface> {{(pid=72426) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:64:67:5a"/><model type="virtio"/><mtu size="1442"/><target dev="tap2054724f-4e"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 01 08:11:27 user nova-compute[72426]:   <name>instance-00000009</name>
Aug 01 08:11:27 user nova-compute[72426]:   <uuid>9c26ba65-f5a0-499b-9891-c84e1530f40f</uuid>
Aug 01 08:11:27 user nova-compute[72426]:   <metadata>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:11:27 user nova-compute[72426]:   <nova:package version="0.0.0"/>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:name>tempest-device-tagging-server-1455569858</nova:name>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:creationTime>2023-08-01 08:11:08</nova:creationTime>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:flavor name="m1.tiny">
Aug 01 08:11:27 user nova-compute[72426]:     <nova:memory>512</nova:memory>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:disk>1</nova:disk>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:swap>0</nova:swap>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:vcpus>1</nova:vcpus>
Aug 01 08:11:27 user nova-compute[72426]:   </nova:flavor>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:owner>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:user uuid="641e3764d33b496ca438a15c878f9be2">tempest-TaggedAttachmentsTest-725575124-project-member</nova:user>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:project uuid="454252382eb548feadc6ea9d263ced60">tempest-TaggedAttachmentsTest-725575124</nova:project>
Aug 01 08:11:27 user nova-compute[72426]:   </nova:owner>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:ports>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:port uuid="7525e311-6c46-4621-94e5-96940d9e88bd">
Aug 01 08:11:27 user nova-compute[72426]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 08:11:27 user nova-compute[72426]:     </nova:port>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:port uuid="2054724f-4e9d-42cd-ab9d-73c686a7a12d">
Aug 01 08:11:27 user nova-compute[72426]:       <nova:ip type="fixed" address="10.10.10.158" ipVersion="4"/>
Aug 01 08:11:27 user nova-compute[72426]:     </nova:port>
Aug 01 08:11:27 user nova-compute[72426]:   </nova:ports>
Aug 01 08:11:27 user nova-compute[72426]: </nova:instance>
Aug 01 08:11:27 user nova-compute[72426]:   </metadata>
Aug 01 08:11:27 user nova-compute[72426]:   <memory unit='KiB'>524288</memory>
Aug 01 08:11:27 user nova-compute[72426]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 08:11:27 user nova-compute[72426]:   <vcpu placement='static'>1</vcpu>
Aug 01 08:11:27 user nova-compute[72426]:   <resource>
Aug 01 08:11:27 user nova-compute[72426]:     <partition>/machine</partition>
Aug 01 08:11:27 user nova-compute[72426]:   </resource>
Aug 01 08:11:27 user nova-compute[72426]:   <sysinfo type='smbios'>
Aug 01 08:11:27 user nova-compute[72426]:     <system>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='version'>0.0.0</entry>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='serial'>9c26ba65-f5a0-499b-9891-c84e1530f40f</entry>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='uuid'>9c26ba65-f5a0-499b-9891-c84e1530f40f</entry>
Aug 01 08:11:27 user nova-compute[72426]:       <entry name='family'>Virtual Machine</entry>
Aug 01 08:11:27 user nova-compute[72426]:     </system>
Aug 01 08:11:27 user nova-compute[72426]:   </sysinfo>
Aug 01 08:11:27 user nova-compute[72426]:   <os>
Aug 01 08:11:27 user nova-compute[72426]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 08:11:27 user nova-compute[72426]:     <boot dev='hd'/>
Aug 01 08:11:27 user nova-compute[72426]:     <smbios mode='sysinfo'/>
Aug 01 08:11:27 user nova-compute[72426]:   </os>
Aug 01 08:11:27 user nova-compute[72426]:   <features>
Aug 01 08:11:27 user nova-compute[72426]:     <acpi/>
Aug 01 08:11:27 user nova-compute[72426]:     <apic/>
Aug 01 08:11:27 user nova-compute[72426]:     <vmcoreinfo state='on'/>
Aug 01 08:11:27 user nova-compute[72426]:   </features>
Aug 01 08:11:27 user nova-compute[72426]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 08:11:27 user nova-compute[72426]:     <model fallback='forbid'>Nehalem</model>
Aug 01 08:11:27 user nova-compute[72426]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 08:11:27 user nova-compute[72426]:     <feature policy='require' name='vme'/>
Aug 01 08:11:27 user nova-compute[72426]:     <feature policy='require' name='x2apic'/>
Aug 01 08:11:27 user nova-compute[72426]:     <feature policy='require' name='hypervisor'/>
Aug 01 08:11:27 user nova-compute[72426]:   </cpu>
Aug 01 08:11:27 user nova-compute[72426]:   <clock offset='utc'>
Aug 01 08:11:27 user nova-compute[72426]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 08:11:27 user nova-compute[72426]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 08:11:27 user nova-compute[72426]:     <timer name='hpet' present='no'/>
Aug 01 08:11:27 user nova-compute[72426]:   </clock>
Aug 01 08:11:27 user nova-compute[72426]:   <on_poweroff>destroy</on_poweroff>
Aug 01 08:11:27 user nova-compute[72426]:   <on_reboot>restart</on_reboot>
Aug 01 08:11:27 user nova-compute[72426]:   <on_crash>destroy</on_crash>
Aug 01 08:11:27 user nova-compute[72426]:   <devices>
Aug 01 08:11:27 user nova-compute[72426]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 08:11:27 user nova-compute[72426]:     <disk type='file' device='disk'>
Aug 01 08:11:27 user nova-compute[72426]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 08:11:27 user nova-compute[72426]:       <source file='/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk' index='2'/>
Aug 01 08:11:27 user nova-compute[72426]:       <backingStore type='file' index='3'>
Aug 01 08:11:27 user nova-compute[72426]:         <format type='raw'/>
Aug 01 08:11:27 user nova-compute[72426]:         <source file='/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9'/>
Aug 01 08:11:27 user nova-compute[72426]:         <backingStore/>
Aug 01 08:11:27 user nova-compute[72426]:       </backingStore>
Aug 01 08:11:27 user nova-compute[72426]:       <target dev='vda' bus='virtio'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='virtio-disk0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </disk>
Aug 01 08:11:27 user nova-compute[72426]:     <disk type='file' device='cdrom'>
Aug 01 08:11:27 user nova-compute[72426]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 08:11:27 user nova-compute[72426]:       <source file='/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/disk.config' index='1'/>
Aug 01 08:11:27 user nova-compute[72426]:       <backingStore/>
Aug 01 08:11:27 user nova-compute[72426]:       <target dev='hda' bus='ide'/>
Aug 01 08:11:27 user nova-compute[72426]:       <readonly/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='ide0-0-0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </disk>
Aug 01 08:11:27 user nova-compute[72426]:     <controller type='usb' index='0' model='none'>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='usb'/>
Aug 01 08:11:27 user nova-compute[72426]:     </controller>
Aug 01 08:11:27 user nova-compute[72426]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='pci.0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </controller>
Aug 01 08:11:27 user nova-compute[72426]:     <controller type='ide' index='0'>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='ide'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 08:11:27 user nova-compute[72426]:     </controller>
Aug 01 08:11:27 user nova-compute[72426]:     <interface type='ethernet'>
Aug 01 08:11:27 user nova-compute[72426]:       <mac address='fa:16:3e:7e:d4:1c'/>
Aug 01 08:11:27 user nova-compute[72426]:       <target dev='tap7525e311-6c'/>
Aug 01 08:11:27 user nova-compute[72426]:       <model type='virtio'/>
Aug 01 08:11:27 user nova-compute[72426]:       <mtu size='1442'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='net0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </interface>
Aug 01 08:11:27 user nova-compute[72426]:     <serial type='pty'>
Aug 01 08:11:27 user nova-compute[72426]:       <source path='/dev/pts/8'/>
Aug 01 08:11:27 user nova-compute[72426]:       <log file='/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/console.log' append='off'/>
Aug 01 08:11:27 user nova-compute[72426]:       <target type='isa-serial' port='0'>
Aug 01 08:11:27 user nova-compute[72426]:         <model name='isa-serial'/>
Aug 01 08:11:27 user nova-compute[72426]:       </target>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='serial0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </serial>
Aug 01 08:11:27 user nova-compute[72426]:     <console type='pty' tty='/dev/pts/8'>
Aug 01 08:11:27 user nova-compute[72426]:       <source path='/dev/pts/8'/>
Aug 01 08:11:27 user nova-compute[72426]:       <log file='/opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f/console.log' append='off'/>
Aug 01 08:11:27 user nova-compute[72426]:       <target type='serial' port='0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='serial0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </console>
Aug 01 08:11:27 user nova-compute[72426]:     <input type='mouse' bus='ps2'>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='input0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </input>
Aug 01 08:11:27 user nova-compute[72426]:     <input type='keyboard' bus='ps2'>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='input1'/>
Aug 01 08:11:27 user nova-compute[72426]:     </input>
Aug 01 08:11:27 user nova-compute[72426]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 01 08:11:27 user nova-compute[72426]:       <listen type='address' address='0.0.0.0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </graphics>
Aug 01 08:11:27 user nova-compute[72426]:     <audio id='1' type='none'/>
Aug 01 08:11:27 user nova-compute[72426]:     <video>
Aug 01 08:11:27 user nova-compute[72426]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='video0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </video>
Aug 01 08:11:27 user nova-compute[72426]:     <memballoon model='virtio'>
Aug 01 08:11:27 user nova-compute[72426]:       <stats period='10'/>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='balloon0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </memballoon>
Aug 01 08:11:27 user nova-compute[72426]:     <rng model='virtio'>
Aug 01 08:11:27 user nova-compute[72426]:       <backend model='random'>/dev/urandom</backend>
Aug 01 08:11:27 user nova-compute[72426]:       <alias name='rng0'/>
Aug 01 08:11:27 user nova-compute[72426]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 08:11:27 user nova-compute[72426]:     </rng>
Aug 01 08:11:27 user nova-compute[72426]:   </devices>
Aug 01 08:11:27 user nova-compute[72426]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 08:11:27 user nova-compute[72426]:     <label>libvirt-9c26ba65-f5a0-499b-9891-c84e1530f40f</label>
Aug 01 08:11:27 user nova-compute[72426]:     <imagelabel>libvirt-9c26ba65-f5a0-499b-9891-c84e1530f40f</imagelabel>
Aug 01 08:11:27 user nova-compute[72426]:   </seclabel>
Aug 01 08:11:27 user nova-compute[72426]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 08:11:27 user nova-compute[72426]:     <label>+64055:+108</label>
Aug 01 08:11:27 user nova-compute[72426]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 08:11:27 user nova-compute[72426]:   </seclabel>
Aug 01 08:11:27 user nova-compute[72426]: </domain>
Aug 01 08:11:27 user nova-compute[72426]:  {{(pid=72426) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 08:11:27 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Successfully detached device tap2054724f-4e from instance 9c26ba65-f5a0-499b-9891-c84e1530f40f from the live domain config.
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455569858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455569858',id=9,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUTKnKkZhlWKyb1LXTXXMdqlOlZZJdmZ9D32CohZpgmKqsMway4Q46JX9kgFrLWSVxlSTmjjnXKE3nj8JkoaJvwMhj80lrL96T/qO9KIMTBN0WYaPWA4D1/DHkKIHvFhg==',key_name='tempest-keypair-215514464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:09:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='454252382eb548feadc6ea9d263ced60',ramdisk_id='',reservation_id='r-3s80pq9a',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-725575124',owner_user_name='tempest-TaggedAttachmentsTest-725575124-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='641e3764d33b496ca438a15c878f9be2',uuid=9c26ba65-f5a0-499b-9891-c84e1530f40f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "address": "fa:16:3e:64:67:5a", "network": {"id": "af3698c2-193b-4a47-86a8-a9fbe39ab2b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1994236515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054724f-4e", "ovs_interfaceid": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converting VIF {"id": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "address": "fa:16:3e:64:67:5a", "network": {"id": "af3698c2-193b-4a47-86a8-a9fbe39ab2b8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1994236515", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2054724f-4e", "ovs_interfaceid": "2054724f-4e9d-42cd-ab9d-73c686a7a12d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:67:5a,bridge_name='br-int',has_traffic_filtering=True,id=2054724f-4e9d-42cd-ab9d-73c686a7a12d,network=Network(af3698c2-193b-4a47-86a8-a9fbe39ab2b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054724f-4e') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG os_vif [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:67:5a,bridge_name='br-int',has_traffic_filtering=True,id=2054724f-4e9d-42cd-ab9d-73c686a7a12d,network=Network(af3698c2-193b-4a47-86a8-a9fbe39ab2b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054724f-4e') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2054724f-4e, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:27 user nova-compute[72426]: INFO os_vif [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:67:5a,bridge_name='br-int',has_traffic_filtering=True,id=2054724f-4e9d-42cd-ab9d-73c686a7a12d,network=Network(af3698c2-193b-4a47-86a8-a9fbe39ab2b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2054724f-4e')
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:11:27 user nova-compute[72426]:   <nova:package version="0.0.0"/>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:name>tempest-device-tagging-server-1455569858</nova:name>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:creationTime>2023-08-01 08:11:27</nova:creationTime>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:flavor name="m1.tiny">
Aug 01 08:11:27 user nova-compute[72426]:     <nova:memory>512</nova:memory>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:disk>1</nova:disk>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:swap>0</nova:swap>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:vcpus>1</nova:vcpus>
Aug 01 08:11:27 user nova-compute[72426]:   </nova:flavor>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:owner>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:user uuid="641e3764d33b496ca438a15c878f9be2">tempest-TaggedAttachmentsTest-725575124-project-member</nova:user>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:project uuid="454252382eb548feadc6ea9d263ced60">tempest-TaggedAttachmentsTest-725575124</nova:project>
Aug 01 08:11:27 user nova-compute[72426]:   </nova:owner>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:11:27 user nova-compute[72426]:   <nova:ports>
Aug 01 08:11:27 user nova-compute[72426]:     <nova:port uuid="7525e311-6c46-4621-94e5-96940d9e88bd">
Aug 01 08:11:27 user nova-compute[72426]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 08:11:27 user nova-compute[72426]:     </nova:port>
Aug 01 08:11:27 user nova-compute[72426]:   </nova:ports>
Aug 01 08:11:27 user nova-compute[72426]: </nova:instance>
Aug 01 08:11:27 user nova-compute[72426]:  {{(pid=72426) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-813ec121-2bf5-44fe-af9b-dbaac41f887f req-74ef8e97-c827-4629-b42e-4a3bac9bdd73 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-unplugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-813ec121-2bf5-44fe-af9b-dbaac41f887f req-74ef8e97-c827-4629-b42e-4a3bac9bdd73 service nova] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-813ec121-2bf5-44fe-af9b-dbaac41f887f req-74ef8e97-c827-4629-b42e-4a3bac9bdd73 service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-813ec121-2bf5-44fe-af9b-dbaac41f887f req-74ef8e97-c827-4629-b42e-4a3bac9bdd73 service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-813ec121-2bf5-44fe-af9b-dbaac41f887f req-74ef8e97-c827-4629-b42e-4a3bac9bdd73 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] No waiting events found dispatching network-vif-unplugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:27 user nova-compute[72426]: WARNING nova.compute.manager [req-813ec121-2bf5-44fe-af9b-dbaac41f887f req-74ef8e97-c827-4629-b42e-4a3bac9bdd73 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received unexpected event network-vif-unplugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d for instance with vm_state active and task_state None.
Aug 01 08:11:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:11:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquired lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:11:28 user nova-compute[72426]: DEBUG nova.network.neutron [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:11:28 user nova-compute[72426]: INFO nova.network.neutron [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Port 2054724f-4e9d-42cd-ab9d-73c686a7a12d from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 01 08:11:28 user nova-compute[72426]: DEBUG nova.network.neutron [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updating instance_info_cache with network_info: [{"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Releasing lock "refresh_cache-9c26ba65-f5a0-499b-9891-c84e1530f40f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:11:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-abf40026-6992-4d18-abf3-f61d80d052a9 tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "interface-9c26ba65-f5a0-499b-9891-c84e1530f40f-2054724f-4e9d-42cd-ab9d-73c686a7a12d" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.685s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-f27ca2b9-e056-4c7b-aa36-a49b74b64964 req-08b9103f-6986-4227-b78f-f75d01f43469 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-plugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f27ca2b9-e056-4c7b-aa36-a49b74b64964 req-08b9103f-6986-4227-b78f-f75d01f43469 service nova] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f27ca2b9-e056-4c7b-aa36-a49b74b64964 req-08b9103f-6986-4227-b78f-f75d01f43469 service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f27ca2b9-e056-4c7b-aa36-a49b74b64964 req-08b9103f-6986-4227-b78f-f75d01f43469 service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-f27ca2b9-e056-4c7b-aa36-a49b74b64964 req-08b9103f-6986-4227-b78f-f75d01f43469 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] No waiting events found dispatching network-vif-plugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:29 user nova-compute[72426]: WARNING nova.compute.manager [req-f27ca2b9-e056-4c7b-aa36-a49b74b64964 req-08b9103f-6986-4227-b78f-f75d01f43469 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received unexpected event network-vif-plugged-2054724f-4e9d-42cd-ab9d-73c686a7a12d for instance with vm_state active and task_state None.
Aug 01 08:11:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-f27ca2b9-e056-4c7b-aa36-a49b74b64964 req-08b9103f-6986-4227-b78f-f75d01f43469 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-deleted-2054724f-4e9d-42cd-ab9d-73c686a7a12d {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:11:37 user nova-compute[72426]: INFO nova.compute.claims [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Claim successful on node user
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877482.3962805, ace240ab-fe78-416a-b45a-85d66b8ac8cd => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:11:37 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] VM Stopped (Lifecycle Event)
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a757c776-0cfd-46c9-b249-242f92bf77f7 None None] [instance: ace240ab-fe78-416a-b45a-85d66b8ac8cd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.network.neutron [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:11:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG nova.policy [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '184d71425948492e835ea8f0dd857d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b6971ed0a343468f071e1e25c27d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:11:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:37 user nova-compute[72426]: INFO nova.virt.block_device [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Booting with blank volume at /dev/vda
Aug 01 08:11:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Successfully created port: 2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:11:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Successfully updated port: 2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:11:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:11:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquired lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:11:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:11:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-d616e649-3581-4918-ac05-a22114f5167f req-4fbfc446-b823-4941-a2ca-138aa45c1556 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-changed-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-d616e649-3581-4918-ac05-a22114f5167f req-4fbfc446-b823-4941-a2ca-138aa45c1556 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Refreshing instance network info cache due to event network-changed-2ab312e8-542a-48ce-992f-055264f86613. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:11:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d616e649-3581-4918-ac05-a22114f5167f req-4fbfc446-b823-4941-a2ca-138aa45c1556 service nova] Acquiring lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:11:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:11:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updating instance_info_cache with network_info: [{"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Releasing lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:11:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Instance network_info: |[{"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:11:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d616e649-3581-4918-ac05-a22114f5167f req-4fbfc446-b823-4941-a2ca-138aa45c1556 service nova] Acquired lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:11:39 user nova-compute[72426]: DEBUG nova.network.neutron [req-d616e649-3581-4918-ac05-a22114f5167f req-4fbfc446-b823-4941-a2ca-138aa45c1556 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Refreshing network info cache for port 2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG nova.network.neutron [req-d616e649-3581-4918-ac05-a22114f5167f req-4fbfc446-b823-4941-a2ca-138aa45c1556 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updated VIF entry in instance network info cache for port 2ab312e8-542a-48ce-992f-055264f86613. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG nova.network.neutron [req-d616e649-3581-4918-ac05-a22114f5167f req-4fbfc446-b823-4941-a2ca-138aa45c1556 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updating instance_info_cache with network_info: [{"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d616e649-3581-4918-ac05-a22114f5167f req-4fbfc446-b823-4941-a2ca-138aa45c1556 service nova] Releasing lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-26edf5d7-f3bb-4dfe-b653-abae5260813f req-e10029d6-fdde-4734-ab0c-aed52ba7a193 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-changed-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-26edf5d7-f3bb-4dfe-b653-abae5260813f req-e10029d6-fdde-4734-ab0c-aed52ba7a193 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing instance network info cache due to event network-changed-481af75c-b92e-4885-b57e-9dc756127867. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-26edf5d7-f3bb-4dfe-b653-abae5260813f req-e10029d6-fdde-4734-ab0c-aed52ba7a193 service nova] Acquiring lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-26edf5d7-f3bb-4dfe-b653-abae5260813f req-e10029d6-fdde-4734-ab0c-aed52ba7a193 service nova] Acquired lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG nova.network.neutron [req-26edf5d7-f3bb-4dfe-b653-abae5260813f req-e10029d6-fdde-4734-ab0c-aed52ba7a193 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Refreshing network info cache for port 481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG nova.network.neutron [req-26edf5d7-f3bb-4dfe-b653-abae5260813f req-e10029d6-fdde-4734-ab0c-aed52ba7a193 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updated VIF entry in instance network info cache for port 481af75c-b92e-4885-b57e-9dc756127867. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG nova.network.neutron [req-26edf5d7-f3bb-4dfe-b653-abae5260813f req-e10029d6-fdde-4734-ab0c-aed52ba7a193 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [{"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-26edf5d7-f3bb-4dfe-b653-abae5260813f req-e10029d6-fdde-4734-ab0c-aed52ba7a193 service nova] Releasing lock "refresh_cache-aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:11:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:42 user nova-compute[72426]: INFO nova.compute.manager [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Terminating instance
Aug 01 08:11:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-293e0ae9-4aee-4cbf-9184-5648a9bf608b req-6eaac5b9-cd2a-4f82-8edd-75cf0eae567e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-293e0ae9-4aee-4cbf-9184-5648a9bf608b req-6eaac5b9-cd2a-4f82-8edd-75cf0eae567e service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-293e0ae9-4aee-4cbf-9184-5648a9bf608b req-6eaac5b9-cd2a-4f82-8edd-75cf0eae567e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-293e0ae9-4aee-4cbf-9184-5648a9bf608b req-6eaac5b9-cd2a-4f82-8edd-75cf0eae567e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-293e0ae9-4aee-4cbf-9184-5648a9bf608b req-6eaac5b9-cd2a-4f82-8edd-75cf0eae567e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-unplugged-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-293e0ae9-4aee-4cbf-9184-5648a9bf608b req-6eaac5b9-cd2a-4f82-8edd-75cf0eae567e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-481af75c-b92e-4885-b57e-9dc756127867 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-3fedba6e-73da-4c61-8e36-8458b30cbcc4 req-5a052d00-7bad-4afd-a542-2834d2f99db6 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3fedba6e-73da-4c61-8e36-8458b30cbcc4 req-5a052d00-7bad-4afd-a542-2834d2f99db6 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3fedba6e-73da-4c61-8e36-8458b30cbcc4 req-5a052d00-7bad-4afd-a542-2834d2f99db6 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3fedba6e-73da-4c61-8e36-8458b30cbcc4 req-5a052d00-7bad-4afd-a542-2834d2f99db6 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-3fedba6e-73da-4c61-8e36-8458b30cbcc4 req-5a052d00-7bad-4afd-a542-2834d2f99db6 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-unplugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-3fedba6e-73da-4c61-8e36-8458b30cbcc4 req-5a052d00-7bad-4afd-a542-2834d2f99db6 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG os_brick.utils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5818dc6-2326-4f4e-a328-8e28d84af748]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5b45f8-d462-4c4c-babc-8fb16f1da585]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfb48dc-a082-4881-a25b-d8b6e6b0ef1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4325e5-2dea-4348-93ed-8455a23b2acd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:11:43 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb274a4b-45b3-49ab-a599-76e6965fb6bc]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG os_brick.utils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updating existing volume attachment record: c823e7d5-96b6-47cc-9211-7826dc965bb5 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-ddc218c3-3ae4-4712-954a-99d1de6d3848 req-c5149561-c362-4a87-89ee-23ffeb5ce8f8 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ddc218c3-3ae4-4712-954a-99d1de6d3848 req-c5149561-c362-4a87-89ee-23ffeb5ce8f8 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ddc218c3-3ae4-4712-954a-99d1de6d3848 req-c5149561-c362-4a87-89ee-23ffeb5ce8f8 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ddc218c3-3ae4-4712-954a-99d1de6d3848 req-c5149561-c362-4a87-89ee-23ffeb5ce8f8 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-ddc218c3-3ae4-4712-954a-99d1de6d3848 req-c5149561-c362-4a87-89ee-23ffeb5ce8f8 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-unplugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-ddc218c3-3ae4-4712-954a-99d1de6d3848 req-c5149561-c362-4a87-89ee-23ffeb5ce8f8 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Instance destroyed successfully.
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.objects.instance [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lazy-loading 'resources' on Instance uuid aae9f4f0-aeda-4008-aaf7-0bc42fa24be4 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:9b:91,bridge_name='br-int',has_traffic_filtering=True,id=481af75c-b92e-4885-b57e-9dc756127867,network=Network(fab236b7-7894-4166-bca9-03c43dece154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481af75c-b9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:9b:91,bridge_name='br-int',has_traffic_filtering=True,id=481af75c-b92e-4885-b57e-9dc756127867,network=Network(fab236b7-7894-4166-bca9-03c43dece154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481af75c-b9') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap481af75c-b9, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: INFO os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:9b:91,bridge_name='br-int',has_traffic_filtering=True,id=481af75c-b92e-4885-b57e-9dc756127867,network=Network(fab236b7-7894-4166-bca9-03c43dece154),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481af75c-b9')
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:98,bridge_name='br-int',has_traffic_filtering=True,id=e3b61ce5-3f14-497d-ab4c-f8c8bff866a4,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b61ce5-3f') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:98,bridge_name='br-int',has_traffic_filtering=True,id=e3b61ce5-3f14-497d-ab4c-f8c8bff866a4,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b61ce5-3f') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3b61ce5-3f, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: INFO os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:98,bridge_name='br-int',has_traffic_filtering=True,id=e3b61ce5-3f14-497d-ab4c-f8c8bff866a4,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape3b61ce5-3f')
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:22:b4,bridge_name='br-int',has_traffic_filtering=True,id=437ed3bd-d3a0-4d08-8f63-9abbb79f09c0,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437ed3bd-d3') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:22:b4,bridge_name='br-int',has_traffic_filtering=True,id=437ed3bd-d3a0-4d08-8f63-9abbb79f09c0,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437ed3bd-d3') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap437ed3bd-d3, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: INFO os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:22:b4,bridge_name='br-int',has_traffic_filtering=True,id=437ed3bd-d3a0-4d08-8f63-9abbb79f09c0,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437ed3bd-d3')
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9b:87,bridge_name='br-int',has_traffic_filtering=True,id=f1dab44c-5c92-4f06-b33a-01ccb747256c,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dab44c-5c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9b:87,bridge_name='br-int',has_traffic_filtering=True,id=f1dab44c-5c92-4f06-b33a-01ccb747256c,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dab44c-5c') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1dab44c-5c, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: INFO os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9b:87,bridge_name='br-int',has_traffic_filtering=True,id=f1dab44c-5c92-4f06-b33a-01ccb747256c,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dab44c-5c')
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "40abf17e-0530-4dd1-90d8-df3fb4646463", "address": "fa:16:3e:71:f4:10", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40abf17e-05", "ovs_interfaceid": "40abf17e-0530-4dd1-90d8-df3fb4646463", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:f4:10,bridge_name='br-int',has_traffic_filtering=True,id=40abf17e-0530-4dd1-90d8-df3fb4646463,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40abf17e-05') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:f4:10,bridge_name='br-int',has_traffic_filtering=True,id=40abf17e-0530-4dd1-90d8-df3fb4646463,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40abf17e-05') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40abf17e-05, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: INFO os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:f4:10,bridge_name='br-int',has_traffic_filtering=True,id=40abf17e-0530-4dd1-90d8-df3fb4646463,network=Network(1aef322e-73b0-49a5-832c-9117cbda634d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40abf17e-05')
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:75:ed,bridge_name='br-int',has_traffic_filtering=True,id=04b5431f-7fcd-48af-9690-9bdd459dfef9,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5431f-7f') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:75:ed,bridge_name='br-int',has_traffic_filtering=True,id=04b5431f-7fcd-48af-9690-9bdd459dfef9,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5431f-7f') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04b5431f-7f, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: INFO os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:75:ed,bridge_name='br-int',has_traffic_filtering=True,id=04b5431f-7fcd-48af-9690-9bdd459dfef9,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5431f-7f')
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455822249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455822249',id=10,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbHCq+qGvusl3SSd2cnUcI6aPtPln99XK+NTqThgz6ugp1FvuGT6aJG/27k5B5sqocAdZhFtu8qj95L9MTC7O6TvEmN7BswBUXZ2QNLkOrY9SZi5tNoNiwGmAouwQjWA==',key_name='tempest-keypair-450596732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95ccf58ada6a420999e1003d91124e6c',ramdisk_id='',reservation_id='r-tqg61fqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-828628340',owner_user_name='tempest-TaggedBootDevicesTest-828628340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0770de0d6a7249dc8f22f4e2b7e9200f',uuid=aae9f4f0-aeda-4008-aaf7-0bc42fa24be4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converting VIF {"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c7:e1,bridge_name='br-int',has_traffic_filtering=True,id=d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a94cb5-b9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c7:e1,bridge_name='br-int',has_traffic_filtering=True,id=d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a94cb5-b9') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2a94cb5-b9, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:44 user nova-compute[72426]: INFO os_vif [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c7:e1,bridge_name='br-int',has_traffic_filtering=True,id=d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5,network=Network(6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a94cb5-b9')
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvolCaQR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:44 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[05022339-f1f4-4e54-8266-e4658e5c5d1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba1cddc-9e22-4cbd-b204-70e4af27ac51]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:44 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:44 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:44 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:44 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:44 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 (non-flash)
Aug 01 08:11:44 user nova-compute[72426]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:44 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:44 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:44 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:44 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c8b8b92d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec133934-375c-402c-a264-062de0ef0f3c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1892469-a37e-4cb4-a064-1b50c61cd063]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0128a0-ad0b-4dc3-a28c-c53c605ba1e2]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2309b603-3820-4019-9b7b-18d2e6405898]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5020305c-c669-4fbb-b69b-5c69afda0c28]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[55adbb3b-2f8b-4581-8e9b-4dc9031e8eab]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907, portal: 172.16.0.220,3260]
Aug 01 08:11:44 user nova-compute[72426]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907, portal: 172.16.0.220,3260] successful.
Aug 01 08:11:44 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d4b24ad-740c-4e2d-9da1-8d15fbbef907 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c204f8aa-183f-4d1f-843a-0b5b07c14472]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] <== disconnect_volume: return (322ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuxGnwOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:44 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c3cd3c-b651-4cd3-a7f8-f382c8c0fac9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[59635637-cda7-4cfc-b1a8-dff4f411de34]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:45 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:45 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:45 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c (non-flash)
Aug 01 08:11:45 user nova-compute[72426]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:45 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:45 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c8b8b97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc63ac3e-7126-4e33-99c5-83668808757c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3338aab2-aca9-4637-9669-79102e9ad202]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e312c5-4b41-45e7-a26e-b6b6623e8d16]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: WARNING nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-481af75c-b92e-4885-b57e-9dc756127867 for instance with vm_state active and task_state deleting.
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-unplugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: WARNING nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-e3b61ce5-3f14-497d-ab4c-f8c8bff866a4 for instance with vm_state active and task_state deleting.
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-unplugged-f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-f1dab44c-5c92-4f06-b33a-01ccb747256c for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: WARNING nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-f1dab44c-5c92-4f06-b33a-01ccb747256c for instance with vm_state active and task_state deleting.
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-unplugged-40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-40abf17e-0530-4dd1-90d8-df3fb4646463 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: WARNING nova.compute.manager [req-13c9c14c-eb0f-4ea6-acc6-2d9cd5d6dda8 req-0b2f940c-e069-4090-a857-e9046407967e service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-40abf17e-0530-4dd1-90d8-df3fb4646463 for instance with vm_state active and task_state deleting.
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[713dfc55-1b46-41b9-bb00-58d521b66056]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ccab13-d7dd-4608-8e04-f649abb6f353]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3d6d96-96d6-4bab-834d-c956a99f6be0]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c, portal: 172.16.0.220,3260]
Aug 01 08:11:45 user nova-compute[72426]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c, portal: 172.16.0.220,3260] successful.
Aug 01 08:11:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc0f185-6af2-4533-ab53-47580617140c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a134a5f-1512-4b38-9099-5aafc925f3d3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] <== disconnect_volume: return (309ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kolSNUAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:45 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: WARNING nova.compute.manager [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-437ed3bd-d3a0-4d08-8f63-9abbb79f09c0 for instance with vm_state active and task_state deleting.
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-unplugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-unplugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: WARNING nova.compute.manager [req-982f5d66-b60a-4439-bcdd-add310c6ddff req-20617797-d0b2-471a-9018-273389f66a5c service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-04b5431f-7fcd-48af-9690-9bdd459dfef9 for instance with vm_state active and task_state deleting.
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ffbbd7-7997-4671-82e4-7529da300193]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd1acf9-c866-402d-9061-491651ca9d66]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:45 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:45 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f (non-flash)
Aug 01 08:11:45 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:11:45 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:11:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c8b8bb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f'): ({'sdd'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Removing single pathed devices sdd {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc587eb-521a-425b-923c-a4fe60f3580b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6209eb-fd52-483f-b9b2-4afcae83981b]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Flushing IO for device /dev/sdd {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40f06c9-99f3-49fe-8570-b3359c52ca07]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3f8843-4f07-444c-9cb4-1ee463b552ec]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2c101d-b496-4257-b24b-311197918b00]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ff1d5e-dc21-46eb-84ea-736c81668adc]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f, portal: 172.16.0.220,3260]
Aug 01 08:11:45 user nova-compute[72426]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f, portal: 172.16.0.220,3260] successful.
Aug 01 08:11:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba568c3-39ad-43a6-ab2e-986fb844c58f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[da69e47c-bc20-4832-a27f-61392d5d0914]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] <== disconnect_volume: return (272ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:11:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Deleting instance files /opt/stack/data/nova/instances/aae9f4f0-aeda-4008-aaf7-0bc42fa24be4_del
Aug 01 08:11:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Deletion of /opt/stack/data/nova/instances/aae9f4f0-aeda-4008-aaf7-0bc42fa24be4_del complete
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-5a152f92-de00-4806-bb58-58b68ada8631 req-e07c2952-30e4-43ff-9c73-8943142dcb98 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-plugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5a152f92-de00-4806-bb58-58b68ada8631 req-e07c2952-30e4-43ff-9c73-8943142dcb98 service nova] Acquiring lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5a152f92-de00-4806-bb58-58b68ada8631 req-e07c2952-30e4-43ff-9c73-8943142dcb98 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5a152f92-de00-4806-bb58-58b68ada8631 req-e07c2952-30e4-43ff-9c73-8943142dcb98 service nova] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-5a152f92-de00-4806-bb58-58b68ada8631 req-e07c2952-30e4-43ff-9c73-8943142dcb98 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] No waiting events found dispatching network-vif-plugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:11:45 user nova-compute[72426]: WARNING nova.compute.manager [req-5a152f92-de00-4806-bb58-58b68ada8631 req-e07c2952-30e4-43ff-9c73-8943142dcb98 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received unexpected event network-vif-plugged-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 for instance with vm_state active and task_state deleting.
Aug 01 08:11:45 user nova-compute[72426]: INFO nova.compute.manager [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Took 3.12 seconds to destroy the instance on the hypervisor.
Aug 01 08:11:45 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:11:45 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:11:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-1bb51c9d-41da-4600-929c-b930367e2505 req-b2b542f9-fe12-407e-bba7-3390514ef304 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-deleted-40abf17e-0530-4dd1-90d8-df3fb4646463 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:47 user nova-compute[72426]: INFO nova.compute.manager [req-1bb51c9d-41da-4600-929c-b930367e2505 req-b2b542f9-fe12-407e-bba7-3390514ef304 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Neutron deleted interface 40abf17e-0530-4dd1-90d8-df3fb4646463; detaching it from the instance and deleting it from the info cache
Aug 01 08:11:47 user nova-compute[72426]: DEBUG nova.network.neutron [req-1bb51c9d-41da-4600-929c-b930367e2505 req-b2b542f9-fe12-407e-bba7-3390514ef304 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [{"id": "481af75c-b92e-4885-b57e-9dc756127867", "address": "fa:16:3e:df:9b:91", "network": {"id": "fab236b7-7894-4166-bca9-03c43dece154", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-732585096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481af75c-b9", "ovs_interfaceid": "481af75c-b92e-4885-b57e-9dc756127867", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "address": "fa:16:3e:55:a5:98", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3b61ce5-3f", "ovs_interfaceid": "e3b61ce5-3f14-497d-ab4c-f8c8bff866a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "address": "fa:16:3e:52:22:b4", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437ed3bd-d3", "ovs_interfaceid": "437ed3bd-d3a0-4d08-8f63-9abbb79f09c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "address": "fa:16:3e:1b:9b:87", "network": {"id": "1aef322e-73b0-49a5-832c-9117cbda634d", "bridge": "br-int", "label": "tempest-device-tagging-net1-592253775", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dab44c-5c", "ovs_interfaceid": "f1dab44c-5c92-4f06-b33a-01ccb747256c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "address": "fa:16:3e:28:75:ed", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5431f-7f", "ovs_interfaceid": "04b5431f-7fcd-48af-9690-9bdd459dfef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "address": "fa:16:3e:41:c7:e1", "network": {"id": "6f0fc5e0-820a-4ee4-9d86-49ce9bbd9428", "bridge": "br-int", "label": "tempest-device-tagging-net2-1591027078", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95ccf58ada6a420999e1003d91124e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a94cb5-b9", "ovs_interfaceid": "d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-1bb51c9d-41da-4600-929c-b930367e2505 req-b2b542f9-fe12-407e-bba7-3390514ef304 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Detach interface failed, port_id=40abf17e-0530-4dd1-90d8-df3fb4646463, reason: Instance aae9f4f0-aeda-4008-aaf7-0bc42fa24be4 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:11:49 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:11:49 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Took 3.47 seconds to deallocate network for instance.
Aug 01 08:11:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-d840b6ac-1bf7-4ab4-badd-c76a5c53d62e req-37d68f31-8500-408e-b938-77c931dd4999 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-deleted-04b5431f-7fcd-48af-9690-9bdd459dfef9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-d840b6ac-1bf7-4ab4-badd-c76a5c53d62e req-37d68f31-8500-408e-b938-77c931dd4999 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-deleted-d2a94cb5-b9d7-4815-a9e4-dcf2122dd5c5 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-d840b6ac-1bf7-4ab4-badd-c76a5c53d62e req-37d68f31-8500-408e-b938-77c931dd4999 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-deleted-481af75c-b92e-4885-b57e-9dc756127867 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-d840b6ac-1bf7-4ab4-badd-c76a5c53d62e req-37d68f31-8500-408e-b938-77c931dd4999 service nova] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Received event network-vif-deleted-f1dab44c-5c92-4f06-b33a-01ccb747256c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:11:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:11:57 user nova-compute[72426]: INFO nova.compute.manager [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Took 8.22 seconds to detach 3 volumes for instance.
Aug 01 08:11:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:57 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:11:57 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:11:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:57 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Deleted allocations for instance aae9f4f0-aeda-4008-aaf7-0bc42fa24be4
Aug 01 08:11:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-da635cbf-e1d3-4955-a2ce-8b97b93b0336 tempest-TaggedBootDevicesTest-828628340 tempest-TaggedBootDevicesTest-828628340-project-member] Lock "aae9f4f0-aeda-4008-aaf7-0bc42fa24be4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.500s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877504.274591, aae9f4f0-aeda-4008-aaf7-0bc42fa24be4 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:11:59 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] VM Stopped (Lifecycle Event)
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-eaded083-54c5-418f-a4c6-0c0ed71cf7c8 None None] [instance: aae9f4f0-aeda-4008-aaf7-0bc42fa24be4] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:11:59 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Creating image(s)
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Ensure instance console log exists: /opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Start _get_guest_xml network_info=[{"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mekxUFXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0efe4ed7-ea8a-485e-b7db-df92ba58f7b6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab6baec9-b9c7-4eb2-8122-1f67cc55672c', 'serial': 'ab6baec9-b9c7-4eb2-8122-1f67cc55672c'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'c823e7d5-96b6-47cc-9211-7826dc965bb5', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:11:59 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:11:59 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mekxUFXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:11:59 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:59 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:11:59 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efc8a63-59e9-44ab-870c-f0a9c8a0abf9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:11:59 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63c9d93-6e3a-4c00-9b88-3a1aac16bfdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c] added
Aug 01 08:11:59 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc24dea3-07b9-4a03-b85d-012670dae305]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[617a49e5-263e-4147-84b2-e83cf581fb2d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mekxUFXI {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mekxUFXI" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78f1693-fa06-45c4-9dae-eedd94ce2182]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mekxUFXI'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca30b5d1-2346-4ec6-850a-beaeaba6d6c8]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:11:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b563d19e-130d-482e-b972-4450237c90ed]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:12:00 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:12:00 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2de884b-d0aa-4e93-86f8-d05c728f9bcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c, portal: 172.16.0.220,3260]
Aug 01 08:12:00 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c, portal: 172.16.0.220,3260] successful.
Aug 01 08:12:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c254cb7-c590-4e05-afbd-30fbf4eb8386]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95905ac-f80a-438a-9c36-865a403b4c55]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:00 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:12:00 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:00 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:12:00 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9282b872-cd37-4ddc-b504-8f3421c4e210]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:00 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mekxUFXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23231613339663464', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231613339663464', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1277733807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1277733807',id=12,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-pq9iq1e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:11:38Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=0efe4ed7-ea8a-485e-b7db-df92ba58f7b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:07,bridge_name='br-int',has_traffic_filtering=True,id=2ab312e8-542a-48ce-992f-055264f86613,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab312e8-54') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.objects.instance [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'pci_devices' on Instance uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:12:01 user nova-compute[72426]:   <uuid>0efe4ed7-ea8a-485e-b7db-df92ba58f7b6</uuid>
Aug 01 08:12:01 user nova-compute[72426]:   <name>instance-0000000c</name>
Aug 01 08:12:01 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:12:01 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:12:01 user nova-compute[72426]:   <metadata>
Aug 01 08:12:01 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:12:01 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:12:01 user nova-compute[72426]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1277733807</nova:name>
Aug 01 08:12:01 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:11:59</nova:creationTime>
Aug 01 08:12:01 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:12:01 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:12:01 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:12:01 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:12:01 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:12:01 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:12:01 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:12:01 user nova-compute[72426]:       <nova:owner>
Aug 01 08:12:01 user nova-compute[72426]:         <nova:user uuid="184d71425948492e835ea8f0dd857d1f">tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member</nova:user>
Aug 01 08:12:01 user nova-compute[72426]:         <nova:project uuid="d0b6971ed0a343468f071e1e25c27d5b">tempest-ServerBootFromVolumeStableRescueTest-2030640431</nova:project>
Aug 01 08:12:01 user nova-compute[72426]:       </nova:owner>
Aug 01 08:12:01 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:12:01 user nova-compute[72426]:       <nova:ports>
Aug 01 08:12:01 user nova-compute[72426]:         <nova:port uuid="2ab312e8-542a-48ce-992f-055264f86613">
Aug 01 08:12:01 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 08:12:01 user nova-compute[72426]:         </nova:port>
Aug 01 08:12:01 user nova-compute[72426]:       </nova:ports>
Aug 01 08:12:01 user nova-compute[72426]:     </nova:instance>
Aug 01 08:12:01 user nova-compute[72426]:   </metadata>
Aug 01 08:12:01 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:12:01 user nova-compute[72426]:     <system>
Aug 01 08:12:01 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:12:01 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:12:01 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:12:01 user nova-compute[72426]:       <entry name="serial">0efe4ed7-ea8a-485e-b7db-df92ba58f7b6</entry>
Aug 01 08:12:01 user nova-compute[72426]:       <entry name="uuid">0efe4ed7-ea8a-485e-b7db-df92ba58f7b6</entry>
Aug 01 08:12:01 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:12:01 user nova-compute[72426]:     </system>
Aug 01 08:12:01 user nova-compute[72426]:   </sysinfo>
Aug 01 08:12:01 user nova-compute[72426]:   <os>
Aug 01 08:12:01 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:12:01 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:12:01 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:12:01 user nova-compute[72426]:   </os>
Aug 01 08:12:01 user nova-compute[72426]:   <features>
Aug 01 08:12:01 user nova-compute[72426]:     <acpi/>
Aug 01 08:12:01 user nova-compute[72426]:     <apic/>
Aug 01 08:12:01 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:12:01 user nova-compute[72426]:   </features>
Aug 01 08:12:01 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:12:01 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:12:01 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:12:01 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:12:01 user nova-compute[72426]:   </clock>
Aug 01 08:12:01 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:12:01 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:12:01 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:12:01 user nova-compute[72426]:   </cpu>
Aug 01 08:12:01 user nova-compute[72426]:   <devices>
Aug 01 08:12:01 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:12:01 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:12:01 user nova-compute[72426]:       <source dev="/dev/sdb"/>
Aug 01 08:12:01 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:12:01 user nova-compute[72426]:       <serial>ab6baec9-b9c7-4eb2-8122-1f67cc55672c</serial>
Aug 01 08:12:01 user nova-compute[72426]:     </disk>
Aug 01 08:12:01 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:12:01 user nova-compute[72426]:       <mac address="fa:16:3e:9e:6b:07"/>
Aug 01 08:12:01 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:12:01 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:12:01 user nova-compute[72426]:       <target dev="tap2ab312e8-54"/>
Aug 01 08:12:01 user nova-compute[72426]:     </interface>
Aug 01 08:12:01 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:12:01 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/console.log" append="off"/>
Aug 01 08:12:01 user nova-compute[72426]:     </serial>
Aug 01 08:12:01 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:12:01 user nova-compute[72426]:     <video>
Aug 01 08:12:01 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:12:01 user nova-compute[72426]:     </video>
Aug 01 08:12:01 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:12:01 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:12:01 user nova-compute[72426]:     </rng>
Aug 01 08:12:01 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:12:01 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:12:01 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:12:01 user nova-compute[72426]:     </memballoon>
Aug 01 08:12:01 user nova-compute[72426]:   </devices>
Aug 01 08:12:01 user nova-compute[72426]: </domain>
Aug 01 08:12:01 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1277733807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1277733807',id=12,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-pq9iq1e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:11:38Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=0efe4ed7-ea8a-485e-b7db-df92ba58f7b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:07,bridge_name='br-int',has_traffic_filtering=True,id=2ab312e8-542a-48ce-992f-055264f86613,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab312e8-54') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG os_vif [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:07,bridge_name='br-int',has_traffic_filtering=True,id=2ab312e8-542a-48ce-992f-055264f86613,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab312e8-54') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ab312e8-54, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ab312e8-54, col_values=(('external_ids', {'iface-id': '2ab312e8-542a-48ce-992f-055264f86613', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:6b:07', 'vm-uuid': '0efe4ed7-ea8a-485e-b7db-df92ba58f7b6'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:01 user nova-compute[72426]: INFO os_vif [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:6b:07,bridge_name='br-int',has_traffic_filtering=True,id=2ab312e8-542a-48ce-992f-055264f86613,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab312e8-54')
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:12:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No VIF found with MAC fa:16:3e:9e:6b:07, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:12:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-eed09998-ba6c-4cf2-841e-3103879be526 req-16216546-56ae-4af2-b389-570a2e465bfe service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-eed09998-ba6c-4cf2-841e-3103879be526 req-16216546-56ae-4af2-b389-570a2e465bfe service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-eed09998-ba6c-4cf2-841e-3103879be526 req-16216546-56ae-4af2-b389-570a2e465bfe service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-eed09998-ba6c-4cf2-841e-3103879be526 req-16216546-56ae-4af2-b389-570a2e465bfe service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-eed09998-ba6c-4cf2-841e-3103879be526 req-16216546-56ae-4af2-b389-570a2e465bfe service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:02 user nova-compute[72426]: WARNING nova.compute.manager [req-eed09998-ba6c-4cf2-841e-3103879be526 req-16216546-56ae-4af2-b389-570a2e465bfe service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state building and task_state spawning.
Aug 01 08:12:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877524.886525, 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:04 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] VM Resumed (Lifecycle Event)
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:12:04 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Instance spawned successfully.
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-adf587b9-d12f-415e-ad50-406f6a5461dc req-252e1f95-0b4f-431e-8496-44c90987107c service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adf587b9-d12f-415e-ad50-406f6a5461dc req-252e1f95-0b4f-431e-8496-44c90987107c service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adf587b9-d12f-415e-ad50-406f6a5461dc req-252e1f95-0b4f-431e-8496-44c90987107c service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-adf587b9-d12f-415e-ad50-406f6a5461dc req-252e1f95-0b4f-431e-8496-44c90987107c service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-adf587b9-d12f-415e-ad50-406f6a5461dc req-252e1f95-0b4f-431e-8496-44c90987107c service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:04 user nova-compute[72426]: WARNING nova.compute.manager [req-adf587b9-d12f-415e-ad50-406f6a5461dc req-252e1f95-0b4f-431e-8496-44c90987107c service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state building and task_state spawning.
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:04 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:12:04 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877524.8889794, 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:04 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] VM Started (Lifecycle Event)
Aug 01 08:12:05 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:05 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:12:05 user nova-compute[72426]: INFO nova.compute.manager [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 01 08:12:05 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:05 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:12:05 user nova-compute[72426]: INFO nova.compute.manager [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Took 28.00 seconds to build instance.
Aug 01 08:12:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6a01bcae-67e3-4d8e-a1a1-6559fca176e8 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.098s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:12:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:12:14 user nova-compute[72426]: INFO nova.compute.claims [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Claim successful on node user
Aug 01 08:12:14 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:12:14 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:12:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:12:15 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.policy [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b37a9ddbd9454c0996c1271a13c941d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebec9a843238456ca5d7fdf893326c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:12:15 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Creating image(s)
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "/opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "/opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk 1073741824" returned: 0 in 0.057s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Successfully created port: d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.165s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Cannot resize image /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lazy-loading 'migration_context' on Instance uuid cbe30b5e-a2e4-4f0c-a3af-44125149bfb6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Ensure instance console log exists: /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Successfully updated port: d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "refresh_cache-cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquired lock "refresh_cache-cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-ce8bc4a1-39a2-4067-a7d4-0745474a75a4 req-c824464c-6245-4f20-b91f-0d9c7c54870d service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Received event network-changed-d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-ce8bc4a1-39a2-4067-a7d4-0745474a75a4 req-c824464c-6245-4f20-b91f-0d9c7c54870d service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Refreshing instance network info cache due to event network-changed-d2311eb0-c943-4c4d-8358-30c8b16ade86. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ce8bc4a1-39a2-4067-a7d4-0745474a75a4 req-c824464c-6245-4f20-b91f-0d9c7c54870d service nova] Acquiring lock "refresh_cache-cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:16 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:12:17 user nova-compute[72426]: INFO nova.compute.claims [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Claim successful on node user
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Updating instance_info_cache with network_info: [{"id": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "address": "fa:16:3e:55:e1:7d", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2311eb0-c9", "ovs_interfaceid": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Releasing lock "refresh_cache-cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Instance network_info: |[{"id": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "address": "fa:16:3e:55:e1:7d", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2311eb0-c9", "ovs_interfaceid": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ce8bc4a1-39a2-4067-a7d4-0745474a75a4 req-c824464c-6245-4f20-b91f-0d9c7c54870d service nova] Acquired lock "refresh_cache-cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.network.neutron [req-ce8bc4a1-39a2-4067-a7d4-0745474a75a4 req-c824464c-6245-4f20-b91f-0d9c7c54870d service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Refreshing network info cache for port d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Start _get_guest_xml network_info=[{"id": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "address": "fa:16:3e:55:e1:7d", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2311eb0-c9", "ovs_interfaceid": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:12:17 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:12:17 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-241111062',display_name='tempest-VolumesAdminNegativeTest-server-241111062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-241111062',id=13,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebec9a843238456ca5d7fdf893326c4f',ramdisk_id='',reservation_id='r-k65oveis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-336374183',owner_user_name='tempest-VolumesAdminNegativeTest-336374183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:12:15Z,user_data=None,user_id='b37a9ddbd9454c0996c1271a13c941d4',uuid=cbe30b5e-a2e4-4f0c-a3af-44125149bfb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "address": "fa:16:3e:55:e1:7d", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2311eb0-c9", "ovs_interfaceid": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converting VIF {"id": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "address": "fa:16:3e:55:e1:7d", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2311eb0-c9", "ovs_interfaceid": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e1:7d,bridge_name='br-int',has_traffic_filtering=True,id=d2311eb0-c943-4c4d-8358-30c8b16ade86,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2311eb0-c9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lazy-loading 'pci_devices' on Instance uuid cbe30b5e-a2e4-4f0c-a3af-44125149bfb6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:12:17 user nova-compute[72426]:   <uuid>cbe30b5e-a2e4-4f0c-a3af-44125149bfb6</uuid>
Aug 01 08:12:17 user nova-compute[72426]:   <name>instance-0000000d</name>
Aug 01 08:12:17 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:12:17 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:12:17 user nova-compute[72426]:   <metadata>
Aug 01 08:12:17 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:12:17 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:12:17 user nova-compute[72426]:       <nova:name>tempest-VolumesAdminNegativeTest-server-241111062</nova:name>
Aug 01 08:12:17 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:12:17</nova:creationTime>
Aug 01 08:12:17 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:12:17 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:12:17 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:12:17 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:12:17 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:12:17 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:12:17 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:12:17 user nova-compute[72426]:       <nova:owner>
Aug 01 08:12:17 user nova-compute[72426]:         <nova:user uuid="b37a9ddbd9454c0996c1271a13c941d4">tempest-VolumesAdminNegativeTest-336374183-project-member</nova:user>
Aug 01 08:12:17 user nova-compute[72426]:         <nova:project uuid="ebec9a843238456ca5d7fdf893326c4f">tempest-VolumesAdminNegativeTest-336374183</nova:project>
Aug 01 08:12:17 user nova-compute[72426]:       </nova:owner>
Aug 01 08:12:17 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:12:17 user nova-compute[72426]:       <nova:ports>
Aug 01 08:12:17 user nova-compute[72426]:         <nova:port uuid="d2311eb0-c943-4c4d-8358-30c8b16ade86">
Aug 01 08:12:17 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 08:12:17 user nova-compute[72426]:         </nova:port>
Aug 01 08:12:17 user nova-compute[72426]:       </nova:ports>
Aug 01 08:12:17 user nova-compute[72426]:     </nova:instance>
Aug 01 08:12:17 user nova-compute[72426]:   </metadata>
Aug 01 08:12:17 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:12:17 user nova-compute[72426]:     <system>
Aug 01 08:12:17 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:12:17 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:12:17 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:12:17 user nova-compute[72426]:       <entry name="serial">cbe30b5e-a2e4-4f0c-a3af-44125149bfb6</entry>
Aug 01 08:12:17 user nova-compute[72426]:       <entry name="uuid">cbe30b5e-a2e4-4f0c-a3af-44125149bfb6</entry>
Aug 01 08:12:17 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:12:17 user nova-compute[72426]:     </system>
Aug 01 08:12:17 user nova-compute[72426]:   </sysinfo>
Aug 01 08:12:17 user nova-compute[72426]:   <os>
Aug 01 08:12:17 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:12:17 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:12:17 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:12:17 user nova-compute[72426]:   </os>
Aug 01 08:12:17 user nova-compute[72426]:   <features>
Aug 01 08:12:17 user nova-compute[72426]:     <acpi/>
Aug 01 08:12:17 user nova-compute[72426]:     <apic/>
Aug 01 08:12:17 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:12:17 user nova-compute[72426]:   </features>
Aug 01 08:12:17 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:12:17 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:12:17 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:12:17 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:12:17 user nova-compute[72426]:   </clock>
Aug 01 08:12:17 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:12:17 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:12:17 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:12:17 user nova-compute[72426]:   </cpu>
Aug 01 08:12:17 user nova-compute[72426]:   <devices>
Aug 01 08:12:17 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:12:17 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:12:17 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk"/>
Aug 01 08:12:17 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:12:17 user nova-compute[72426]:     </disk>
Aug 01 08:12:17 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:12:17 user nova-compute[72426]:       <mac address="fa:16:3e:55:e1:7d"/>
Aug 01 08:12:17 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:12:17 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:12:17 user nova-compute[72426]:       <target dev="tapd2311eb0-c9"/>
Aug 01 08:12:17 user nova-compute[72426]:     </interface>
Aug 01 08:12:17 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:12:17 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/console.log" append="off"/>
Aug 01 08:12:17 user nova-compute[72426]:     </serial>
Aug 01 08:12:17 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:12:17 user nova-compute[72426]:     <video>
Aug 01 08:12:17 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:12:17 user nova-compute[72426]:     </video>
Aug 01 08:12:17 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:12:17 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:12:17 user nova-compute[72426]:     </rng>
Aug 01 08:12:17 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:12:17 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:12:17 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:12:17 user nova-compute[72426]:     </memballoon>
Aug 01 08:12:17 user nova-compute[72426]:   </devices>
Aug 01 08:12:17 user nova-compute[72426]: </domain>
Aug 01 08:12:17 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-241111062',display_name='tempest-VolumesAdminNegativeTest-server-241111062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-241111062',id=13,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebec9a843238456ca5d7fdf893326c4f',ramdisk_id='',reservation_id='r-k65oveis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-336374183',owner_user_name='tempest-VolumesAdminNegativeTest-336374183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:12:15Z,user_data=None,user_id='b37a9ddbd9454c0996c1271a13c941d4',uuid=cbe30b5e-a2e4-4f0c-a3af-44125149bfb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "address": "fa:16:3e:55:e1:7d", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2311eb0-c9", "ovs_interfaceid": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converting VIF {"id": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "address": "fa:16:3e:55:e1:7d", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2311eb0-c9", "ovs_interfaceid": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e1:7d,bridge_name='br-int',has_traffic_filtering=True,id=d2311eb0-c943-4c4d-8358-30c8b16ade86,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2311eb0-c9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG os_vif [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e1:7d,bridge_name='br-int',has_traffic_filtering=True,id=d2311eb0-c943-4c4d-8358-30c8b16ade86,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2311eb0-c9') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2311eb0-c9, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2311eb0-c9, col_values=(('external_ids', {'iface-id': 'd2311eb0-c943-4c4d-8358-30c8b16ade86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:e1:7d', 'vm-uuid': 'cbe30b5e-a2e4-4f0c-a3af-44125149bfb6'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:17 user nova-compute[72426]: INFO os_vif [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e1:7d,bridge_name='br-int',has_traffic_filtering=True,id=d2311eb0-c943-4c4d-8358-30c8b16ade86,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2311eb0-c9')
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] No VIF found with MAC fa:16:3e:55:e1:7d, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.network.neutron [req-ce8bc4a1-39a2-4067-a7d4-0745474a75a4 req-c824464c-6245-4f20-b91f-0d9c7c54870d service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Updated VIF entry in instance network info cache for port d2311eb0-c943-4c4d-8358-30c8b16ade86. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.network.neutron [req-ce8bc4a1-39a2-4067-a7d4-0745474a75a4 req-c824464c-6245-4f20-b91f-0d9c7c54870d service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Updating instance_info_cache with network_info: [{"id": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "address": "fa:16:3e:55:e1:7d", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2311eb0-c9", "ovs_interfaceid": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ce8bc4a1-39a2-4067-a7d4-0745474a75a4 req-c824464c-6245-4f20-b91f-0d9c7c54870d service nova] Releasing lock "refresh_cache-cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:12:17 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.policy [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2845bfd89e8e4057ac9464f5bf3b52be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2a913710a44a50927c9e68e9807367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:12:17 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Creating image(s)
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "/opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "/opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "/opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk 1073741824" returned: 0 in 0.078s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:18 user nova-compute[72426]: INFO nova.compute.manager [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Terminating instance
Aug 01 08:12:18 user nova-compute[72426]: INFO nova.compute.manager [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Terminating instance
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Cannot resize image /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.objects.instance [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lazy-loading 'migration_context' on Instance uuid 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Ensure instance console log exists: /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Successfully created port: 66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-cc7e7550-7353-4499-af0e-ed2917877129 req-4b70cc1a-43b7-495e-a093-1f2ce18a929a service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received event network-vif-unplugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cc7e7550-7353-4499-af0e-ed2917877129 req-4b70cc1a-43b7-495e-a093-1f2ce18a929a service nova] Acquiring lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cc7e7550-7353-4499-af0e-ed2917877129 req-4b70cc1a-43b7-495e-a093-1f2ce18a929a service nova] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cc7e7550-7353-4499-af0e-ed2917877129 req-4b70cc1a-43b7-495e-a093-1f2ce18a929a service nova] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-cc7e7550-7353-4499-af0e-ed2917877129 req-4b70cc1a-43b7-495e-a093-1f2ce18a929a service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] No waiting events found dispatching network-vif-unplugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-cc7e7550-7353-4499-af0e-ed2917877129 req-4b70cc1a-43b7-495e-a093-1f2ce18a929a service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received event network-vif-unplugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.compute.manager [req-dce9f0eb-37d1-4e95-9474-fea91d666b7b req-0a7c8f6b-519b-4ee2-b5da-daa20c68e522 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Received event network-vif-plugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dce9f0eb-37d1-4e95-9474-fea91d666b7b req-0a7c8f6b-519b-4ee2-b5da-daa20c68e522 service nova] Acquiring lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dce9f0eb-37d1-4e95-9474-fea91d666b7b req-0a7c8f6b-519b-4ee2-b5da-daa20c68e522 service nova] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dce9f0eb-37d1-4e95-9474-fea91d666b7b req-0a7c8f6b-519b-4ee2-b5da-daa20c68e522 service nova] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.compute.manager [req-dce9f0eb-37d1-4e95-9474-fea91d666b7b req-0a7c8f6b-519b-4ee2-b5da-daa20c68e522 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] No waiting events found dispatching network-vif-plugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:19 user nova-compute[72426]: WARNING nova.compute.manager [req-dce9f0eb-37d1-4e95-9474-fea91d666b7b req-0a7c8f6b-519b-4ee2-b5da-daa20c68e522 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Received unexpected event network-vif-plugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 for instance with vm_state building and task_state spawning.
Aug 01 08:12:19 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Instance destroyed successfully.
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.objects.instance [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lazy-loading 'resources' on Instance uuid 26f6d35a-d2e0-4ec3-b482-4d66593d0207 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1871066471',display_name='tempest-TestVolumeBootPattern-server-1871066471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1871066471',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:10:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-4t4kuotq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:10:49Z,user_data=None,user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=26f6d35a-d2e0-4ec3-b482-4d66593d0207,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "address": "fa:16:3e:2b:83:df", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2dee5e-58", "ovs_interfaceid": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "address": "fa:16:3e:2b:83:df", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f2dee5e-58", "ovs_interfaceid": "5f2dee5e-5857-42c8-8937-d8207d3142b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:83:df,bridge_name='br-int',has_traffic_filtering=True,id=5f2dee5e-5857-42c8-8937-d8207d3142b7,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2dee5e-58') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_vif [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:83:df,bridge_name='br-int',has_traffic_filtering=True,id=5f2dee5e-5857-42c8-8937-d8207d3142b7,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2dee5e-58') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f2dee5e-58, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:19 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Instance destroyed successfully.
Aug 01 08:12:19 user nova-compute[72426]: INFO os_vif [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:83:df,bridge_name='br-int',has_traffic_filtering=True,id=5f2dee5e-5857-42c8-8937-d8207d3142b7,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f2dee5e-58')
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.objects.instance [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lazy-loading 'resources' on Instance uuid 9c26ba65-f5a0-499b-9891-c84e1530f40f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455569858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455569858',id=9,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUTKnKkZhlWKyb1LXTXXMdqlOlZZJdmZ9D32CohZpgmKqsMway4Q46JX9kgFrLWSVxlSTmjjnXKE3nj8JkoaJvwMhj80lrL96T/qO9KIMTBN0WYaPWA4D1/DHkKIHvFhg==',key_name='tempest-keypair-215514464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:09:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='454252382eb548feadc6ea9d263ced60',ramdisk_id='',reservation_id='r-3s80pq9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-725575124',owner_user_name='tempest-TaggedAttachmentsTest-725575124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='641e3764d33b496ca438a15c878f9be2',uuid=9c26ba65-f5a0-499b-9891-c84e1530f40f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converting VIF {"id": "7525e311-6c46-4621-94e5-96940d9e88bd", "address": "fa:16:3e:7e:d4:1c", "network": {"id": "2b502c96-9201-4be8-83a4-28c70a20299c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1405916069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "454252382eb548feadc6ea9d263ced60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7525e311-6c", "ovs_interfaceid": "7525e311-6c46-4621-94e5-96940d9e88bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:d4:1c,bridge_name='br-int',has_traffic_filtering=True,id=7525e311-6c46-4621-94e5-96940d9e88bd,network=Network(2b502c96-9201-4be8-83a4-28c70a20299c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525e311-6c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_vif [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:d4:1c,bridge_name='br-int',has_traffic_filtering=True,id=7525e311-6c46-4621-94e5-96940d9e88bd,network=Network(2b502c96-9201-4be8-83a4-28c70a20299c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525e311-6c') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uLiSjqDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:19 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7525e311-6c, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:12:19 user nova-compute[72426]: INFO os_vif [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:d4:1c,bridge_name='br-int',has_traffic_filtering=True,id=7525e311-6c46-4621-94e5-96940d9e88bd,network=Network(2b502c96-9201-4be8-83a4-28c70a20299c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7525e311-6c')
Aug 01 08:12:19 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Deleting instance files /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f_del
Aug 01 08:12:19 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Deletion of /opt/stack/data/nova/instances/9c26ba65-f5a0-499b-9891-c84e1530f40f_del complete
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[45391dd9-21be-4eaf-ab0d-8bc1ee133d63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d39eef-6e0b-4b19-ab02-9baeb18c897b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:19 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:12:19 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:19 user nova-compute[72426]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a (non-flash)
Aug 01 08:12:19 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c5071c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a'): ({'sde'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Removing single pathed devices sde {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f4324c-87dd-4347-9626-8a13ba7ac4da]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[543282c2-314e-42b3-9165-c4146ed19b92]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flushing IO for device /dev/sde {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.047s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1813b19e-13f0-44b6-aec2-8b2bf7c92774]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:19 user nova-compute[72426]: INFO nova.compute.manager [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Took 1.77 seconds to destroy the instance on the hypervisor.
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.066s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb54bfd-cf71-471b-be99-3fd78da8d6fc]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] SCSI volumes sde have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:12:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[77636894-0428-49de-954c-2542ccfb1ea1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[57770d7a-2e28-4dbe-81ed-dca592d17171]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a, portal: 172.16.0.220,3260]
Aug 01 08:12:20 user nova-compute[72426]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a, portal: 172.16.0.220,3260] successful.
Aug 01 08:12:20 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bce268c-1a04-4d20-ae05-32161638368a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e96375-d52c-467b-9429-0f3aea7ebcd6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== disconnect_volume: return (400ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:12:20 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Deleting instance files /opt/stack/data/nova/instances/26f6d35a-d2e0-4ec3-b482-4d66593d0207_del
Aug 01 08:12:20 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Deletion of /opt/stack/data/nova/instances/26f6d35a-d2e0-4ec3-b482-4d66593d0207_del complete
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Successfully updated port: 66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "refresh_cache-00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquired lock "refresh_cache-00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:12:20 user nova-compute[72426]: INFO nova.compute.manager [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Took 2.11 seconds to destroy the instance on the hypervisor.
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received event network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Acquiring lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] No waiting events found dispatching network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:20 user nova-compute[72426]: WARNING nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received unexpected event network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 for instance with vm_state active and task_state deleting.
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-unplugged-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] No waiting events found dispatching network-vif-unplugged-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-unplugged-7525e311-6c46-4621-94e5-96940d9e88bd for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Received event network-changed-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Refreshing instance network info cache due to event network-changed-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:12:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Acquiring lock "refresh_cache-00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-5029d9a2-d068-4f18-8394-3e91efa5e209 req-60dd52a2-1828-4654-abd9-1261f346c1e2 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Received event network-vif-plugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5029d9a2-d068-4f18-8394-3e91efa5e209 req-60dd52a2-1828-4654-abd9-1261f346c1e2 service nova] Acquiring lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5029d9a2-d068-4f18-8394-3e91efa5e209 req-60dd52a2-1828-4654-abd9-1261f346c1e2 service nova] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5029d9a2-d068-4f18-8394-3e91efa5e209 req-60dd52a2-1828-4654-abd9-1261f346c1e2 service nova] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-5029d9a2-d068-4f18-8394-3e91efa5e209 req-60dd52a2-1828-4654-abd9-1261f346c1e2 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] No waiting events found dispatching network-vif-plugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:21 user nova-compute[72426]: WARNING nova.compute.manager [req-5029d9a2-d068-4f18-8394-3e91efa5e209 req-60dd52a2-1828-4654-abd9-1261f346c1e2 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Received unexpected event network-vif-plugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 for instance with vm_state building and task_state spawning.
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Updating instance_info_cache with network_info: [{"id": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "address": "fa:16:3e:99:58:26", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ffdfd7-0c", "ovs_interfaceid": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Releasing lock "refresh_cache-00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Instance network_info: |[{"id": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "address": "fa:16:3e:99:58:26", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ffdfd7-0c", "ovs_interfaceid": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Acquired lock "refresh_cache-00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Refreshing network info cache for port 66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Start _get_guest_xml network_info=[{"id": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "address": "fa:16:3e:99:58:26", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ffdfd7-0c", "ovs_interfaceid": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:12:21 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:12:21 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2077957354',display_name='tempest-VolumesActionsTest-instance-2077957354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2077957354',id=14,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc2a913710a44a50927c9e68e9807367',ramdisk_id='',reservation_id='r-b39q8shi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-55827117',owner_user_name='tempest-VolumesActionsTest-55827117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:12:18Z,user_data=None,user_id='2845bfd89e8e4057ac9464f5bf3b52be',uuid=00bfb96d-49b7-47f7-8cb9-0e4730f5ee80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "address": "fa:16:3e:99:58:26", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ffdfd7-0c", "ovs_interfaceid": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converting VIF {"id": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "address": "fa:16:3e:99:58:26", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ffdfd7-0c", "ovs_interfaceid": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:26,bridge_name='br-int',has_traffic_filtering=True,id=66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ffdfd7-0c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.objects.instance [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lazy-loading 'pci_devices' on Instance uuid 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:12:21 user nova-compute[72426]:   <uuid>00bfb96d-49b7-47f7-8cb9-0e4730f5ee80</uuid>
Aug 01 08:12:21 user nova-compute[72426]:   <name>instance-0000000e</name>
Aug 01 08:12:21 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:12:21 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:12:21 user nova-compute[72426]:   <metadata>
Aug 01 08:12:21 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:12:21 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:12:21 user nova-compute[72426]:       <nova:name>tempest-VolumesActionsTest-instance-2077957354</nova:name>
Aug 01 08:12:21 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:12:21</nova:creationTime>
Aug 01 08:12:21 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:12:21 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:12:21 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:12:21 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:12:21 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:12:21 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:12:21 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:12:21 user nova-compute[72426]:       <nova:owner>
Aug 01 08:12:21 user nova-compute[72426]:         <nova:user uuid="2845bfd89e8e4057ac9464f5bf3b52be">tempest-VolumesActionsTest-55827117-project-member</nova:user>
Aug 01 08:12:21 user nova-compute[72426]:         <nova:project uuid="fc2a913710a44a50927c9e68e9807367">tempest-VolumesActionsTest-55827117</nova:project>
Aug 01 08:12:21 user nova-compute[72426]:       </nova:owner>
Aug 01 08:12:21 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:12:21 user nova-compute[72426]:       <nova:ports>
Aug 01 08:12:21 user nova-compute[72426]:         <nova:port uuid="66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee">
Aug 01 08:12:21 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 08:12:21 user nova-compute[72426]:         </nova:port>
Aug 01 08:12:21 user nova-compute[72426]:       </nova:ports>
Aug 01 08:12:21 user nova-compute[72426]:     </nova:instance>
Aug 01 08:12:21 user nova-compute[72426]:   </metadata>
Aug 01 08:12:21 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:12:21 user nova-compute[72426]:     <system>
Aug 01 08:12:21 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:12:21 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:12:21 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:12:21 user nova-compute[72426]:       <entry name="serial">00bfb96d-49b7-47f7-8cb9-0e4730f5ee80</entry>
Aug 01 08:12:21 user nova-compute[72426]:       <entry name="uuid">00bfb96d-49b7-47f7-8cb9-0e4730f5ee80</entry>
Aug 01 08:12:21 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:12:21 user nova-compute[72426]:     </system>
Aug 01 08:12:21 user nova-compute[72426]:   </sysinfo>
Aug 01 08:12:21 user nova-compute[72426]:   <os>
Aug 01 08:12:21 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:12:21 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:12:21 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:12:21 user nova-compute[72426]:   </os>
Aug 01 08:12:21 user nova-compute[72426]:   <features>
Aug 01 08:12:21 user nova-compute[72426]:     <acpi/>
Aug 01 08:12:21 user nova-compute[72426]:     <apic/>
Aug 01 08:12:21 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:12:21 user nova-compute[72426]:   </features>
Aug 01 08:12:21 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:12:21 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:12:21 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:12:21 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:12:21 user nova-compute[72426]:   </clock>
Aug 01 08:12:21 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:12:21 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:12:21 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:12:21 user nova-compute[72426]:   </cpu>
Aug 01 08:12:21 user nova-compute[72426]:   <devices>
Aug 01 08:12:21 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:12:21 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:12:21 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk"/>
Aug 01 08:12:21 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:12:21 user nova-compute[72426]:     </disk>
Aug 01 08:12:21 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:12:21 user nova-compute[72426]:       <mac address="fa:16:3e:99:58:26"/>
Aug 01 08:12:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:12:21 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:12:21 user nova-compute[72426]:       <target dev="tap66ffdfd7-0c"/>
Aug 01 08:12:21 user nova-compute[72426]:     </interface>
Aug 01 08:12:21 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:12:21 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/console.log" append="off"/>
Aug 01 08:12:21 user nova-compute[72426]:     </serial>
Aug 01 08:12:21 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:12:21 user nova-compute[72426]:     <video>
Aug 01 08:12:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:12:21 user nova-compute[72426]:     </video>
Aug 01 08:12:21 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:12:21 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:12:21 user nova-compute[72426]:     </rng>
Aug 01 08:12:21 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:12:21 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:12:21 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:12:21 user nova-compute[72426]:     </memballoon>
Aug 01 08:12:21 user nova-compute[72426]:   </devices>
Aug 01 08:12:21 user nova-compute[72426]: </domain>
Aug 01 08:12:21 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2077957354',display_name='tempest-VolumesActionsTest-instance-2077957354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2077957354',id=14,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc2a913710a44a50927c9e68e9807367',ramdisk_id='',reservation_id='r-b39q8shi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-55827117',owner_user_name='tempest-VolumesActionsTest-55827117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:12:18Z,user_data=None,user_id='2845bfd89e8e4057ac9464f5bf3b52be',uuid=00bfb96d-49b7-47f7-8cb9-0e4730f5ee80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "address": "fa:16:3e:99:58:26", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ffdfd7-0c", "ovs_interfaceid": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converting VIF {"id": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "address": "fa:16:3e:99:58:26", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ffdfd7-0c", "ovs_interfaceid": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:26,bridge_name='br-int',has_traffic_filtering=True,id=66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ffdfd7-0c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG os_vif [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:26,bridge_name='br-int',has_traffic_filtering=True,id=66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ffdfd7-0c') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-e7465a78-339b-41e6-ac97-118f0ee576b9 req-3f8680cf-d46b-430e-ae3e-87e83e95083a service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received event network-vif-deleted-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:21 user nova-compute[72426]: INFO nova.compute.manager [req-e7465a78-339b-41e6-ac97-118f0ee576b9 req-3f8680cf-d46b-430e-ae3e-87e83e95083a service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Neutron deleted interface 5f2dee5e-5857-42c8-8937-d8207d3142b7; detaching it from the instance and deleting it from the info cache
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-e7465a78-339b-41e6-ac97-118f0ee576b9 req-3f8680cf-d46b-430e-ae3e-87e83e95083a service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877541.758786, cbe30b5e-a2e4-4f0c-a3af-44125149bfb6 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:21 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] VM Resumed (Lifecycle Event)
Aug 01 08:12:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66ffdfd7-0c, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66ffdfd7-0c, col_values=(('external_ids', {'iface-id': '66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:58:26', 'vm-uuid': '00bfb96d-49b7-47f7-8cb9-0e4730f5ee80'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:21 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Took 1.52 seconds to deallocate network for instance.
Aug 01 08:12:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:21 user nova-compute[72426]: INFO os_vif [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:26,bridge_name='br-int',has_traffic_filtering=True,id=66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ffdfd7-0c')
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:21 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Instance spawned successfully.
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-e7465a78-339b-41e6-ac97-118f0ee576b9 req-3f8680cf-d46b-430e-ae3e-87e83e95083a service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Detach interface failed, port_id=5f2dee5e-5857-42c8-8937-d8207d3142b7, reason: Instance 26f6d35a-d2e0-4ec3-b482-4d66593d0207 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:12:21 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877541.76664, cbe30b5e-a2e4-4f0c-a3af-44125149bfb6 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:21 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] VM Started (Lifecycle Event)
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] No VIF found with MAC fa:16:3e:99:58:26, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:22 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:12:22 user nova-compute[72426]: INFO nova.compute.manager [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Took 6.83 seconds to spawn the instance on the hypervisor.
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:22 user nova-compute[72426]: INFO nova.compute.manager [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Took 7.67 seconds to build instance.
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ac6dbbc2-6727-4135-968b-b56fdd27bc7e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.804s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:12:22 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Took 2.53 seconds to deallocate network for instance.
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'flavor' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.network.neutron [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Updated VIF entry in instance network info cache for port 66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.network.neutron [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Updating instance_info_cache with network_info: [{"id": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "address": "fa:16:3e:99:58:26", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ffdfd7-0c", "ovs_interfaceid": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Releasing lock "refresh_cache-00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-plugged-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Acquiring lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] No waiting events found dispatching network-vif-plugged-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:22 user nova-compute[72426]: WARNING nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received unexpected event network-vif-plugged-7525e311-6c46-4621-94e5-96940d9e88bd for instance with vm_state active and task_state deleting.
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received event network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Acquiring lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] No waiting events found dispatching network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:22 user nova-compute[72426]: WARNING nova.compute.manager [req-73cd0f53-752f-4330-aec1-b75a9d5f732c req-5ae73943-b863-4d2a-9971-1f526877783e service nova] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Received unexpected event network-vif-plugged-5f2dee5e-5857-42c8-8937-d8207d3142b7 for instance with vm_state active and task_state deleting.
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:22 user nova-compute[72426]: INFO nova.compute.manager [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Took 0.98 seconds to detach 1 volumes for instance.
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Deleting volume: 1bce268c-1a04-4d20-ae05-32161638368a {{(pid=72426) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:22 user nova-compute[72426]: INFO nova.compute.manager [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Attaching volume 65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 to /dev/vdb
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-8aa8f987-ed5d-4da9-ab25-e6612f4ca141 req-96ea95f7-1021-499b-90cb-aea3f3527112 service nova] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Received event network-vif-deleted-7525e311-6c46-4621-94e5-96940d9e88bd {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG os_brick.utils [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d48784-12f8-457f-a212-233cbab5fcab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55d2aa6-610c-4885-b8f0-fbabf5c14bd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d617f4da-4637-4385-8f34-2d5cc5bd54e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51165a2-bdb7-4235-8078-33ef530dc70c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:12:23 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8693f9a-0bf2-4462-b6de-197d97d59e92]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG os_brick.utils [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updating existing volume attachment record: 9cae0985-02b0-4aa4-b06e-13b171af6e59 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.637s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.275s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:23 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Deleted allocations for instance 9c26ba65-f5a0-499b-9891-c84e1530f40f
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6767c59a-341d-4699-9c17-f98cff6a858c tempest-TaggedAttachmentsTest-725575124 tempest-TaggedAttachmentsTest-725575124-project-member] Lock "9c26ba65-f5a0-499b-9891-c84e1530f40f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.284s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.628s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:23 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Deleted allocations for instance 26f6d35a-d2e0-4ec3-b482-4d66593d0207
Aug 01 08:12:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bffbd60f-8fed-4b4b-acc6-2ac7bad8677c tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "26f6d35a-d2e0-4ec3-b482-4d66593d0207" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.954s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877545.9112086, 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:26 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] VM Resumed (Lifecycle Event)
Aug 01 08:12:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Received event network-vif-plugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] Acquiring lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] No waiting events found dispatching network-vif-plugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:26 user nova-compute[72426]: WARNING nova.compute.manager [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Received unexpected event network-vif-plugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee for instance with vm_state building and task_state spawning.
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Received event network-vif-plugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] Acquiring lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] No waiting events found dispatching network-vif-plugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:26 user nova-compute[72426]: WARNING nova.compute.manager [req-3a55e037-a75c-46f3-903b-f7ca50d898a8 req-654fa336-646b-435d-a48e-5054619b0852 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Received unexpected event network-vif-plugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee for instance with vm_state building and task_state spawning.
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:26 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Instance spawned successfully.
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:12:26 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:12:26 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8107MB free_disk=25.887168884277344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:26 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877545.9115586, 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:26 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] VM Started (Lifecycle Event)
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:12:26 user nova-compute[72426]: INFO nova.compute.manager [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Took 8.93 seconds to spawn the instance on the hypervisor.
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:26 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:12:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 457df7dd-4e0f-4d72-915b-644f0c8588eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance f826ffe7-92dc-4f05-9298-1236513a1af2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance cbe30b5e-a2e4-4f0c-a3af-44125149bfb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:12:26 user nova-compute[72426]: INFO nova.compute.manager [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Took 9.74 seconds to build instance.
Aug 01 08:12:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3137b3e9-5e57-4dcf-99c2-20c092f42c0c tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.882s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:27 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:12:27 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:12:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:12:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:12:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:12:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:12:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:12:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:12:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:12:28 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance_info_cache with network_info: [{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG nova.objects.instance [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'flavor' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:30 user nova-compute[72426]: INFO nova.compute.manager [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Attaching volume 46683ff1-19fb-4c9c-8af3-48f1e1fcc57e to /dev/vdb
Aug 01 08:12:30 user nova-compute[72426]: DEBUG os_brick.utils [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7805cec5-f269-41d5-8fcb-be10fbcc4399]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[193695c2-db2c-453f-954e-349d14cd4a84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9dd165-1f8f-4c75-8fcd-a88be878e654]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aaaadf-3362-4b19-aabb-c28eff228f0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:12:30 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:12:30 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba32fed-9566-4234-b58d-d9b5050ab68f]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG os_brick.utils [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:30 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating existing volume attachment record: ab33db26-057e-48fc-b442-1ae644e7bd5c {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:12:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScfqmYZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:32 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:12:32 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:12:32 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbae7cc-ef6b-4d9c-bcb9-3acbdd88f19c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:12:32 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[59429200-1fd1-435e-80aa-ea4f93587400]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3] added
Aug 01 08:12:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[710d2ed9-99dc-45a9-8ab7-4389079b0f00]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7852dc49-a74c-4a9d-a9fb-adc8af1f324d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScfqmYZE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScfqmYZE" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf49b0a-11e7-4681-9f0f-19b3b560c3da]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ScfqmYZE'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[32414eaf-03fe-4565-bd49-89bde97990a0]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4fe057-cb16-4a53-b21e-e43ccacde2a5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:32 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:32 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0ae773-7c4c-4628-83e5-81043f3ee894]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260]
Aug 01 08:12:32 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260] successful.
Aug 01 08:12:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56576b8-9f77-4ad9-b76b-f8f22093c3e7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e44f34f-d23c-47b9-9ff8-321883fc38ec]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:32 user nova-compute[72426]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:12:32 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:32 user nova-compute[72426]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:12:32 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25dc67e-53c0-4175-934d-9ec029379526]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:12:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScfqmYZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:12:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26134383663643036', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134383663643036', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:12:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'flavor' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:12:33 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:12:33 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:12:33 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:12:33 user nova-compute[72426]:   <serial>65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3</serial>
Aug 01 08:12:33 user nova-compute[72426]: </disk>
Aug 01 08:12:33 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:12:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:12:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:12:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No VIF found with MAC fa:16:3e:83:20:2c, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:12:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d511579a-0234-4af1-9eb5-81c866b88962 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.568s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:34 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877539.6174707, 26f6d35a-d2e0-4ec3-b482-4d66593d0207 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:34 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] VM Stopped (Lifecycle Event)
Aug 01 08:12:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-137b4e01-7055-43bc-b92e-030225a18fb6 None None] [instance: 26f6d35a-d2e0-4ec3-b482-4d66593d0207] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:34 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877539.6652246, 9c26ba65-f5a0-499b-9891-c84e1530f40f => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:34 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] VM Stopped (Lifecycle Event)
Aug 01 08:12:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f4982e61-abb4-4b00-90e2-d533b11a8a7c None None] [instance: 9c26ba65-f5a0-499b-9891-c84e1530f40f] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:36 user nova-compute[72426]: INFO nova.compute.manager [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Rebuilding instance
Aug 01 08:12:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'trusted_certs' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'pci_requests' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'pci_devices' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'resources' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'migration_context' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72426) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-ee527283-209f-4e48-8909-464cc95798a5 req-25f7e3f4-fd47-4e7a-95ac-4a6fa274c395 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-vif-unplugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ee527283-209f-4e48-8909-464cc95798a5 req-25f7e3f4-fd47-4e7a-95ac-4a6fa274c395 service nova] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ee527283-209f-4e48-8909-464cc95798a5 req-25f7e3f4-fd47-4e7a-95ac-4a6fa274c395 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ee527283-209f-4e48-8909-464cc95798a5 req-25f7e3f4-fd47-4e7a-95ac-4a6fa274c395 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-ee527283-209f-4e48-8909-464cc95798a5 req-25f7e3f4-fd47-4e7a-95ac-4a6fa274c395 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] No waiting events found dispatching network-vif-unplugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:36 user nova-compute[72426]: WARNING nova.compute.manager [req-ee527283-209f-4e48-8909-464cc95798a5 req-25f7e3f4-fd47-4e7a-95ac-4a6fa274c395 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received unexpected event network-vif-unplugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 for instance with vm_state active and task_state rebuilding.
Aug 01 08:12:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Instance destroyed successfully.
Aug 01 08:12:37 user nova-compute[72426]: INFO nova.compute.manager [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Detaching volume 65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3
Aug 01 08:12:37 user nova-compute[72426]: INFO nova.virt.block_device [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Attempting to driver detach volume 65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 from mountpoint /dev/vdb
Aug 01 08:12:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Attempting to detach device vdb from instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:12:37 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:12:37 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:12:37 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:12:37 user nova-compute[72426]:   <serial>65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3</serial>
Aug 01 08:12:37 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:12:37 user nova-compute[72426]: </disk>
Aug 01 08:12:37 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:12:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully detached device vdb from instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d from the persistent domain config.
Aug 01 08:12:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScfqmYZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:37 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0194bff6-f31d-4bde-9e73-4e850505dee0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b104feea-64c2-41af-8e05-802b4db03683]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:37 user nova-compute[72426]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:12:37 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:37 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:37 user nova-compute[72426]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:12:37 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:37 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c46eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd557a1-372c-4033-a65a-2a4b5e2e366c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb84590-aa87-4f28-af95-c1df805e5876]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4473eb3e-b7d3-4750-a2df-81d8a5553fd3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb0f0a2-256a-42b3-9a36-0f19497d0e87]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27e14d4-99ec-4195-817f-eceede516199]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f4ae9e-4b23-49c3-a17e-48a82a1b1a8d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260]
Aug 01 08:12:37 user nova-compute[72426]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260] successful.
Aug 01 08:12:37 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89d8b50-18db-4338-abd8-5a1bfe89e052]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== disconnect_volume: return (308ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:38 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Instance destroyed successfully.
Aug 01 08:12:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-118503701',display_name='tempest-ServerActionsTestOtherA-server-1394724544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-118503701',id=3,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:08:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-rcue7ywk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=df66e0b7-acbf-48a2-b165-7d4a4fbf790d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_vif [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap883a5e52-34, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:12:38 user nova-compute[72426]: INFO os_vif [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34')
Aug 01 08:12:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScfqmYZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:38 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7de6150-1bee-43d5-9369-0fe305942c3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[756dbe28-19ca-4a4c-a914-768ee6bf2645]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:38 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:38 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:38 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:38 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c46c4c0>, {}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Disconnecting from: [] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.066s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== disconnect_volume: return (68ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:12:38 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Deleting instance files /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d_del
Aug 01 08:12:38 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Deletion of /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d_del complete
Aug 01 08:12:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-45139921-71f8-4131-9f80-5684075e70de req-37e7a9af-8f0e-43c3-b62c-0d12e659b3d2 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-45139921-71f8-4131-9f80-5684075e70de req-37e7a9af-8f0e-43c3-b62c-0d12e659b3d2 service nova] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-45139921-71f8-4131-9f80-5684075e70de req-37e7a9af-8f0e-43c3-b62c-0d12e659b3d2 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-45139921-71f8-4131-9f80-5684075e70de req-37e7a9af-8f0e-43c3-b62c-0d12e659b3d2 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-45139921-71f8-4131-9f80-5684075e70de req-37e7a9af-8f0e-43c3-b62c-0d12e659b3d2 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] No waiting events found dispatching network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:38 user nova-compute[72426]: WARNING nova.compute.manager [req-45139921-71f8-4131-9f80-5684075e70de req-37e7a9af-8f0e-43c3-b62c-0d12e659b3d2 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received unexpected event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 for instance with vm_state active and task_state rebuilding.
Aug 01 08:12:38 user nova-compute[72426]: INFO nova.virt.block_device [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Booting with volume 65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 at /dev/vdb
Aug 01 08:12:39 user nova-compute[72426]: DEBUG os_brick.utils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b6d681-73a2-4fff-9a47-f5a364460f47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[26399adc-250d-4605-9a5c-9cff0950e9ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7754cf0e-9a20-4c7f-a1ef-ac449d2a36f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af019cd-2c57-4fc1-87bb-c52c46a6b023]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:12:39 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:12:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fc7d07-39d0-429a-855d-b2acd112384c]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG os_brick.utils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:39 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updating existing volume attachment record: 490d00a7-8712-4514-8dcf-734f7569dd03 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:12:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:41 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:12:41 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:12:41 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc29e2-8876-4361-8a3b-3752f666694e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:12:41 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6095bd-32de-4d6c-911d-b21f01d530c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e] added
Aug 01 08:12:41 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[606462a9-06d4-4384-87fe-b468da7bc8fe]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9952bec-936a-4d65-8ab9-2c05995d34be]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBuUPAKz {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBuUPAKz" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da67f7d-01f3-41a7-80d0-b9125b7d74b0]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZBuUPAKz'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b747ba1-e5a9-4ed0-a9cf-04dc13cd3988]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d65d988-1f9d-451a-990e-ccf2bf9d0d72]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:41 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:41 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:41 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:41 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[18276139-686d-42e0-9903-91e27c2059cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]
Aug 01 08:12:41 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.
Aug 01 08:12:41 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef8858-8f95-4470-bafd-a0b63fc486f1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3a8fc0-64d9-4823-bf39-9d88427b8511]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:41 user nova-compute[72426]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:12:41 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:41 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:41 user nova-compute[72426]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:12:41 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:41 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cab5a34-1129-4b12-a5b2-f909d7082898]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:12:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:12:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23362316166383539', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362316166383539', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:12:42 user nova-compute[72426]: DEBUG nova.objects.instance [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'flavor' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:12:42 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:12:42 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:12:42 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:12:42 user nova-compute[72426]:   <serial>46683ff1-19fb-4c9c-8af3-48f1e1fcc57e</serial>
Aug 01 08:12:42 user nova-compute[72426]: </disk>
Aug 01 08:12:42 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:12:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:12:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:12:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] No VIF found with MAC fa:16:3e:84:24:c8, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:12:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-221f9b46-e9fa-4d3e-b73c-564dab4eb211 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.354s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Stashing vm_state: active {{(pid=72426) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 08:12:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'pci_requests' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:12:46 user nova-compute[72426]: INFO nova.compute.claims [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Claim successful on node user
Aug 01 08:12:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'resources' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'pci_devices' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:46 user nova-compute[72426]: INFO nova.compute.resource_tracker [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating resource usage from migration 490eac06-5751-4282-82c7-09b668751b0b
Aug 01 08:12:47 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:12:47 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:12:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.514s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:47 user nova-compute[72426]: INFO nova.compute.manager [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Migrating
Aug 01 08:12:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:12:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:12:47 user nova-compute[72426]: INFO nova.compute.rpcapi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 01 08:12:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:12:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:12:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquired lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:12:47 user nova-compute[72426]: DEBUG nova.network.neutron [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance_info_cache with network_info: [{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Releasing lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Starting migrate_disk_and_power_off {{(pid=72426) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-13ccc016-3511-4c55-86a0-bf8cd2d6559e req-5bc17951-cd45-4bc6-a43d-84dfaa381cc6 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-unplugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13ccc016-3511-4c55-86a0-bf8cd2d6559e req-5bc17951-cd45-4bc6-a43d-84dfaa381cc6 service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13ccc016-3511-4c55-86a0-bf8cd2d6559e req-5bc17951-cd45-4bc6-a43d-84dfaa381cc6 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-13ccc016-3511-4c55-86a0-bf8cd2d6559e req-5bc17951-cd45-4bc6-a43d-84dfaa381cc6 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-13ccc016-3511-4c55-86a0-bf8cd2d6559e req-5bc17951-cd45-4bc6-a43d-84dfaa381cc6 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-unplugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:48 user nova-compute[72426]: WARNING nova.compute.manager [req-13ccc016-3511-4c55-86a0-bf8cd2d6559e req-5bc17951-cd45-4bc6-a43d-84dfaa381cc6 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-unplugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state active and task_state resize_migrating.
Aug 01 08:12:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance destroyed successfully.
Aug 01 08:12:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-422374365',display_name='tempest-ServerActionsTestOtherB-server-422374365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-422374365',id=4,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl2oApS4LEi4Ig2bO8yUSo9wl16TwUkqqncZenLkty2XY524bkKbL5wZtWU4/2TUExag9ZWoRoLkyDVuWFoEcjk8zjc/94JyqcQHN/o4NaNjQ0nXMRCRju0bzFZ7w6HLQ==',key_name='tempest-keypair-1006503589',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32d0ba9feb9244e88cb3945f553c8ac7',ramdisk_id='',reservation_id='r-zqp59lbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-252722777',owner_user_name='tempest-ServerActionsTestOtherB-252722777-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fec3b4665a148e498a731cfeef7f589',uuid=dad9feb1-d5fa-4ed2-9fe3-1573010446f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-958659898-network", "vif_mac": "fa:16:3e:84:24:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converting VIF {"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-958659898-network", "vif_mac": "fa:16:3e:84:24:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_vif [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap197ec10c-39, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:12:49 user nova-compute[72426]: INFO os_vif [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39')
Aug 01 08:12:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:49 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2ec8d4-1a9d-4469-8d46-66ceba2d00fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a109bc4-9065-4011-82cf-7fbb5bb951a1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:49 user nova-compute[72426]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:12:49 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:49 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:49 user nova-compute[72426]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:12:49 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:49 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c39ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[38366947-2a13-4ce3-8ab8-131e4903606a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[18630720-9f57-411a-9023-afd5eaef466f]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85bf91d-dba3-4f01-9688-e3a9ac2a3205]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[776a11b6-4264-480c-9435-6dced438a9e3]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08892c9-30b6-41c3-8067-754f4e912d4b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b56e9-1251-4e22-89a9-93b96f0420c3]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]
Aug 01 08:12:49 user nova-compute[72426]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.
Aug 01 08:12:49 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[61498b64-3d8a-4de4-9999-67e904c8a746]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] <== disconnect_volume: return (293ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:12:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6_resize/disk /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "cp -r /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6_resize/disk /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk" returned: 0 in 0.314s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6_resize/disk.info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk.info {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "cp -r /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6_resize/disk.info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk.info" returned: 0 in 0.034s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:12:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Creating image(s)
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "/opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "/opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "/opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk 1073741824" returned: 0 in 0.057s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-f6c59a0f-f93c-4bf0-a455-8e1b53af5ac5 req-92f92625-4269-487f-b0d5-b8c350fa711c service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f6c59a0f-f93c-4bf0-a455-8e1b53af5ac5 req-92f92625-4269-487f-b0d5-b8c350fa711c service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f6c59a0f-f93c-4bf0-a455-8e1b53af5ac5 req-92f92625-4269-487f-b0d5-b8c350fa711c service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f6c59a0f-f93c-4bf0-a455-8e1b53af5ac5 req-92f92625-4269-487f-b0d5-b8c350fa711c service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-f6c59a0f-f93c-4bf0-a455-8e1b53af5ac5 req-92f92625-4269-487f-b0d5-b8c350fa711c service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:50 user nova-compute[72426]: WARNING nova.compute.manager [req-f6c59a0f-f93c-4bf0-a455-8e1b53af5ac5 req-92f92625-4269-487f-b0d5-b8c350fa711c service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state active and task_state resize_migrating.
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Cannot resize image /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Ensure instance console log exists: /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Start _get_guest_xml network_info=[{"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScfqmYZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df66e0b7-acbf-48a2-b165-7d4a4fbf790d', 'attached_at': '', 'detached_at': '', 'volume_id': '65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3', 'serial': '65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '490d00a7-8712-4514-8dcf-734f7569dd03', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:12:51 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 08:12:51 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'vcpu_model' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScfqmYZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:51 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:12:51 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:12:51 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.network.neutron [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Port 197ec10c-39a4-4c89-b675-b7bb2ee90b1f binding to destination host user is already ACTIVE {{(pid=72426) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3a6b8d-7b1f-4214-ae76-84dc832239da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:12:51 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[de277590-57db-44f9-ae92-5d2712f684ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3] added
Aug 01 08:12:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59ae248-a2ba-4469-9266-c1a9f3bbea68]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94e9498-8758-42cb-b65c-4acb13fac6a3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScfqmYZE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScfqmYZE" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ec4860-7131-4990-be32-65662ae6b265]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ScfqmYZE'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff738fd-3af6-481f-98f6-c52f95360258]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9239aae-3a18-4faa-96c6-4520e5047226]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:51 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:51 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba1bcdb-10c1-4fa4-806b-78f4e0a6edfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260]
Aug 01 08:12:51 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260] successful.
Aug 01 08:12:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31c17ac-bb2b-4438-b5cb-1a5940f6f15d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e695bf-d8fc-4df9-ba59-f36600208a08]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:51 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:12:51 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:12:51 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:12:51 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:12:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquired lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG nova.network.neutron [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dbeb1d-ac09-4f41-bd27-9c591edd3aa1]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScfqmYZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:12:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877557.074375, df66e0b7-acbf-48a2-b165-7d4a4fbf790d => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:52 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] VM Stopped (Lifecycle Event)
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4a02d06b-f40d-4448-9c71-598f34971d1f None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.network.neutron [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance_info_cache with network_info: [{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Releasing lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG os_brick.utils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43f7ea8-f87b-4453-8089-23bfbcf6a11d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f233fdd-5535-46e5-9a0b-cce5a239338e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d77cbd-0a76-4bd0-97f6-9f9c93d36edc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3c91a9-f68d-4303-9b9e-f8f3aab394a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:12:52 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:12:52 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[14559434-cd56-4b4e-8eb9-c22fdb1aab84]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG os_brick.utils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26134383663643036', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134383663643036', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-118503701',display_name='tempest-ServerActionsTestOtherA-server-1394724544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-118503701',id=3,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:08:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-rcue7ywk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=df66e0b7-acbf-48a2-b165-7d4a4fbf790d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:12:52 user nova-compute[72426]:   <uuid>df66e0b7-acbf-48a2-b165-7d4a4fbf790d</uuid>
Aug 01 08:12:52 user nova-compute[72426]:   <name>instance-00000003</name>
Aug 01 08:12:52 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:12:52 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:12:52 user nova-compute[72426]:   <metadata>
Aug 01 08:12:52 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:12:52 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:12:52 user nova-compute[72426]:       <nova:name>tempest-ServerActionsTestOtherA-server-1394724544</nova:name>
Aug 01 08:12:52 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:12:51</nova:creationTime>
Aug 01 08:12:52 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:12:52 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:12:52 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:12:52 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:12:52 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:12:52 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:12:52 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:12:52 user nova-compute[72426]:       <nova:owner>
Aug 01 08:12:52 user nova-compute[72426]:         <nova:user uuid="63a663fe54d7469a97f5642e0847a2d4">tempest-ServerActionsTestOtherA-355781192-project-member</nova:user>
Aug 01 08:12:52 user nova-compute[72426]:         <nova:project uuid="77facd98c6ac4726939b5599e6c72a9b">tempest-ServerActionsTestOtherA-355781192</nova:project>
Aug 01 08:12:52 user nova-compute[72426]:       </nova:owner>
Aug 01 08:12:52 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:12:52 user nova-compute[72426]:       <nova:ports>
Aug 01 08:12:52 user nova-compute[72426]:         <nova:port uuid="883a5e52-3445-4ce9-aebd-8a5c59e18e63">
Aug 01 08:12:52 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 08:12:52 user nova-compute[72426]:         </nova:port>
Aug 01 08:12:52 user nova-compute[72426]:       </nova:ports>
Aug 01 08:12:52 user nova-compute[72426]:     </nova:instance>
Aug 01 08:12:52 user nova-compute[72426]:   </metadata>
Aug 01 08:12:52 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:12:52 user nova-compute[72426]:     <system>
Aug 01 08:12:52 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:12:52 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:12:52 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:12:52 user nova-compute[72426]:       <entry name="serial">df66e0b7-acbf-48a2-b165-7d4a4fbf790d</entry>
Aug 01 08:12:52 user nova-compute[72426]:       <entry name="uuid">df66e0b7-acbf-48a2-b165-7d4a4fbf790d</entry>
Aug 01 08:12:52 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:12:52 user nova-compute[72426]:     </system>
Aug 01 08:12:52 user nova-compute[72426]:   </sysinfo>
Aug 01 08:12:52 user nova-compute[72426]:   <os>
Aug 01 08:12:52 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:12:52 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:12:52 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:12:52 user nova-compute[72426]:   </os>
Aug 01 08:12:52 user nova-compute[72426]:   <features>
Aug 01 08:12:52 user nova-compute[72426]:     <acpi/>
Aug 01 08:12:52 user nova-compute[72426]:     <apic/>
Aug 01 08:12:52 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:12:52 user nova-compute[72426]:   </features>
Aug 01 08:12:52 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:12:52 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:12:52 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:12:52 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:12:52 user nova-compute[72426]:   </clock>
Aug 01 08:12:52 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:12:52 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:12:52 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:12:52 user nova-compute[72426]:   </cpu>
Aug 01 08:12:52 user nova-compute[72426]:   <devices>
Aug 01 08:12:52 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:12:52 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:12:52 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk"/>
Aug 01 08:12:52 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:12:52 user nova-compute[72426]:     </disk>
Aug 01 08:12:52 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:12:52 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:12:52 user nova-compute[72426]:       <source dev="/dev/sdc"/>
Aug 01 08:12:52 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:12:52 user nova-compute[72426]:       <serial>65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3</serial>
Aug 01 08:12:52 user nova-compute[72426]:     </disk>
Aug 01 08:12:52 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:12:52 user nova-compute[72426]:       <mac address="fa:16:3e:83:20:2c"/>
Aug 01 08:12:52 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:12:52 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:12:52 user nova-compute[72426]:       <target dev="tap883a5e52-34"/>
Aug 01 08:12:52 user nova-compute[72426]:     </interface>
Aug 01 08:12:52 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:12:52 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/console.log" append="off"/>
Aug 01 08:12:52 user nova-compute[72426]:     </serial>
Aug 01 08:12:52 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:12:52 user nova-compute[72426]:     <video>
Aug 01 08:12:52 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:12:52 user nova-compute[72426]:     </video>
Aug 01 08:12:52 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:12:52 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:12:52 user nova-compute[72426]:     </rng>
Aug 01 08:12:52 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:12:52 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:12:52 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:12:52 user nova-compute[72426]:     </memballoon>
Aug 01 08:12:52 user nova-compute[72426]:   </devices>
Aug 01 08:12:52 user nova-compute[72426]: </domain>
Aug 01 08:12:52 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-118503701',display_name='tempest-ServerActionsTestOtherA-server-1394724544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-118503701',id=3,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:08:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-rcue7ywk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=df66e0b7-acbf-48a2-b165-7d4a4fbf790d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG os_vif [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap883a5e52-34, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap883a5e52-34, col_values=(('external_ids', {'iface-id': '883a5e52-3445-4ce9-aebd-8a5c59e18e63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:20:2c', 'vm-uuid': 'df66e0b7-acbf-48a2-b165-7d4a4fbf790d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:52 user nova-compute[72426]: INFO os_vif [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34')
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:12:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No VIF found with MAC fa:16:3e:83:20:2c, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-af34839c-2f8f-422a-be95-57a88222ce59 req-93782b1e-7c08-4e89-96ee-60eeb3893739 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-af34839c-2f8f-422a-be95-57a88222ce59 req-93782b1e-7c08-4e89-96ee-60eeb3893739 service nova] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-af34839c-2f8f-422a-be95-57a88222ce59 req-93782b1e-7c08-4e89-96ee-60eeb3893739 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-af34839c-2f8f-422a-be95-57a88222ce59 req-93782b1e-7c08-4e89-96ee-60eeb3893739 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-af34839c-2f8f-422a-be95-57a88222ce59 req-93782b1e-7c08-4e89-96ee-60eeb3893739 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] No waiting events found dispatching network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:54 user nova-compute[72426]: WARNING nova.compute.manager [req-af34839c-2f8f-422a-be95-57a88222ce59 req-93782b1e-7c08-4e89-96ee-60eeb3893739 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received unexpected event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 08:12:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-34019592-b769-4061-8a8a-16bfcffa2703 req-5bec80d4-964e-40fd-b664-7ce73f1cb631 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-34019592-b769-4061-8a8a-16bfcffa2703 req-5bec80d4-964e-40fd-b664-7ce73f1cb631 service nova] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-34019592-b769-4061-8a8a-16bfcffa2703 req-5bec80d4-964e-40fd-b664-7ce73f1cb631 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-34019592-b769-4061-8a8a-16bfcffa2703 req-5bec80d4-964e-40fd-b664-7ce73f1cb631 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-34019592-b769-4061-8a8a-16bfcffa2703 req-5bec80d4-964e-40fd-b664-7ce73f1cb631 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] No waiting events found dispatching network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:12:56 user nova-compute[72426]: WARNING nova.compute.manager [req-34019592-b769-4061-8a8a-16bfcffa2703 req-5bec80d4-964e-40fd-b664-7ce73f1cb631 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received unexpected event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 08:12:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877576.6539469, df66e0b7-acbf-48a2-b165-7d4a4fbf790d => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:56 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] VM Resumed (Lifecycle Event)
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:12:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Instance spawned successfully.
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:12:56 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877576.6561103, df66e0b7-acbf-48a2-b165-7d4a4fbf790d => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:12:56 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] VM Started (Lifecycle Event)
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:12:56 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72426) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 08:12:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad0c4ce9-e164-4cf3-908e-dd626ca491ec tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:12:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Starting finish_migration {{(pid=72426) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance directory exists: not creating {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 08:13:01 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Creating image(s)
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'trusted_certs' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.206s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk. size=21474836480 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk 21474836480 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk 21474836480" returned: 0 in 0.058s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Ensure instance console log exists: /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Start _get_guest_xml network_info=[{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-958659898-network", "vif_mac": "fa:16:3e:84:24:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dad9feb1-d5fa-4ed2-9fe3-1573010446f6', 'attached_at': '2023-08-01T08:13:01.000000', 'detached_at': '', 'volume_id': '46683ff1-19fb-4c9c-8af3-48f1e1fcc57e', 'serial': '46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '21bf4989-fe3c-4899-a6b7-3ae740922717', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:13:01 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:01 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'vcpu_model' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:13:01 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:13:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:13:01 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:13:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:13:01 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b63563c-1f4d-436b-b231-1bee30e04f6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:13:01 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c79e45a-79d4-42ee-88f4-bbdfe69220fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e] added
Aug 01 08:13:01 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[38adf585-c1e9-4a29-a568-1bc0f175b19d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74a4c63-ed10-4be7-9383-0158cc370bcb]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBuUPAKz {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBuUPAKz" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcd8720-e7b5-40f5-b35a-9a210a56db62]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZBuUPAKz'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5007345-408e-4649-adad-6d0727a3d68c]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89a3508-7643-499b-a2b2-3c45fdf2688d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:02 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:02 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:02 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:02 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:02 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:02 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9a4f1b-df52-403c-8525-dda1aafa8e23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]
Aug 01 08:13:02 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.
Aug 01 08:13:02 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5365d244-985e-4207-9b87-433a1797e417]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a760e2-5449-4852-b38a-4cb869529c9b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:02 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:02 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:02 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:02 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:02 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:02 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:02 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:02 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c8b2aa-5ad8-4d6c-a20f-bcf3baadb2a0]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:13:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23362316166383539', 'path': '/dev/sdd'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362316166383539', 'path': '/dev/sdd'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-422374365',display_name='tempest-ServerActionsTestOtherB-server-422374365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-422374365',id=4,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl2oApS4LEi4Ig2bO8yUSo9wl16TwUkqqncZenLkty2XY524bkKbL5wZtWU4/2TUExag9ZWoRoLkyDVuWFoEcjk8zjc/94JyqcQHN/o4NaNjQ0nXMRCRju0bzFZ7w6HLQ==',key_name='tempest-keypair-1006503589',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32d0ba9feb9244e88cb3945f553c8ac7',ramdisk_id='',reservation_id='r-zqp59lbx',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-252722777',owner_user_name='tempest-ServerActionsTestOtherB-252722777-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fec3b4665a148e498a731cfeef7f589',uuid=dad9feb1-d5fa-4ed2-9fe3-1573010446f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-958659898-network", "vif_mac": "fa:16:3e:84:24:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converting VIF {"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-958659898-network", "vif_mac": "fa:16:3e:84:24:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:13:03 user nova-compute[72426]:   <uuid>dad9feb1-d5fa-4ed2-9fe3-1573010446f6</uuid>
Aug 01 08:13:03 user nova-compute[72426]:   <name>instance-00000004</name>
Aug 01 08:13:03 user nova-compute[72426]:   <memory>2097152</memory>
Aug 01 08:13:03 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:13:03 user nova-compute[72426]:   <metadata>
Aug 01 08:13:03 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:13:03 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:13:03 user nova-compute[72426]:       <nova:name>tempest-ServerActionsTestOtherB-server-422374365</nova:name>
Aug 01 08:13:03 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:13:01</nova:creationTime>
Aug 01 08:13:03 user nova-compute[72426]:       <nova:flavor name="m1.small">
Aug 01 08:13:03 user nova-compute[72426]:         <nova:memory>2048</nova:memory>
Aug 01 08:13:03 user nova-compute[72426]:         <nova:disk>20</nova:disk>
Aug 01 08:13:03 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:13:03 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:13:03 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:13:03 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:13:03 user nova-compute[72426]:       <nova:owner>
Aug 01 08:13:03 user nova-compute[72426]:         <nova:user uuid="4fec3b4665a148e498a731cfeef7f589">tempest-ServerActionsTestOtherB-252722777-project-member</nova:user>
Aug 01 08:13:03 user nova-compute[72426]:         <nova:project uuid="32d0ba9feb9244e88cb3945f553c8ac7">tempest-ServerActionsTestOtherB-252722777</nova:project>
Aug 01 08:13:03 user nova-compute[72426]:       </nova:owner>
Aug 01 08:13:03 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:13:03 user nova-compute[72426]:       <nova:ports>
Aug 01 08:13:03 user nova-compute[72426]:         <nova:port uuid="197ec10c-39a4-4c89-b675-b7bb2ee90b1f">
Aug 01 08:13:03 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 08:13:03 user nova-compute[72426]:         </nova:port>
Aug 01 08:13:03 user nova-compute[72426]:       </nova:ports>
Aug 01 08:13:03 user nova-compute[72426]:     </nova:instance>
Aug 01 08:13:03 user nova-compute[72426]:   </metadata>
Aug 01 08:13:03 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:13:03 user nova-compute[72426]:     <system>
Aug 01 08:13:03 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:13:03 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:13:03 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:13:03 user nova-compute[72426]:       <entry name="serial">dad9feb1-d5fa-4ed2-9fe3-1573010446f6</entry>
Aug 01 08:13:03 user nova-compute[72426]:       <entry name="uuid">dad9feb1-d5fa-4ed2-9fe3-1573010446f6</entry>
Aug 01 08:13:03 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:13:03 user nova-compute[72426]:     </system>
Aug 01 08:13:03 user nova-compute[72426]:   </sysinfo>
Aug 01 08:13:03 user nova-compute[72426]:   <os>
Aug 01 08:13:03 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:13:03 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:13:03 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:13:03 user nova-compute[72426]:   </os>
Aug 01 08:13:03 user nova-compute[72426]:   <features>
Aug 01 08:13:03 user nova-compute[72426]:     <acpi/>
Aug 01 08:13:03 user nova-compute[72426]:     <apic/>
Aug 01 08:13:03 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:13:03 user nova-compute[72426]:   </features>
Aug 01 08:13:03 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:13:03 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:13:03 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:13:03 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:13:03 user nova-compute[72426]:   </clock>
Aug 01 08:13:03 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:13:03 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:13:03 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:13:03 user nova-compute[72426]:   </cpu>
Aug 01 08:13:03 user nova-compute[72426]:   <devices>
Aug 01 08:13:03 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:13:03 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:13:03 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk"/>
Aug 01 08:13:03 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:13:03 user nova-compute[72426]:     </disk>
Aug 01 08:13:03 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:13:03 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:13:03 user nova-compute[72426]:       <source dev="/dev/sdd"/>
Aug 01 08:13:03 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:13:03 user nova-compute[72426]:       <serial>46683ff1-19fb-4c9c-8af3-48f1e1fcc57e</serial>
Aug 01 08:13:03 user nova-compute[72426]:     </disk>
Aug 01 08:13:03 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:13:03 user nova-compute[72426]:       <mac address="fa:16:3e:84:24:c8"/>
Aug 01 08:13:03 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:03 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:13:03 user nova-compute[72426]:       <target dev="tap197ec10c-39"/>
Aug 01 08:13:03 user nova-compute[72426]:     </interface>
Aug 01 08:13:03 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:13:03 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/console.log" append="off"/>
Aug 01 08:13:03 user nova-compute[72426]:     </serial>
Aug 01 08:13:03 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:13:03 user nova-compute[72426]:     <video>
Aug 01 08:13:03 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:03 user nova-compute[72426]:     </video>
Aug 01 08:13:03 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:13:03 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:13:03 user nova-compute[72426]:     </rng>
Aug 01 08:13:03 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:13:03 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:13:03 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:13:03 user nova-compute[72426]:     </memballoon>
Aug 01 08:13:03 user nova-compute[72426]:   </devices>
Aug 01 08:13:03 user nova-compute[72426]: </domain>
Aug 01 08:13:03 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-422374365',display_name='tempest-ServerActionsTestOtherB-server-422374365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-422374365',id=4,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl2oApS4LEi4Ig2bO8yUSo9wl16TwUkqqncZenLkty2XY524bkKbL5wZtWU4/2TUExag9ZWoRoLkyDVuWFoEcjk8zjc/94JyqcQHN/o4NaNjQ0nXMRCRju0bzFZ7w6HLQ==',key_name='tempest-keypair-1006503589',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32d0ba9feb9244e88cb3945f553c8ac7',ramdisk_id='',reservation_id='r-zqp59lbx',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-252722777',owner_user_name='tempest-ServerActionsTestOtherB-252722777-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fec3b4665a148e498a731cfeef7f589',uuid=dad9feb1-d5fa-4ed2-9fe3-1573010446f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-958659898-network", "vif_mac": "fa:16:3e:84:24:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converting VIF {"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-958659898-network", "vif_mac": "fa:16:3e:84:24:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG os_vif [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap197ec10c-39, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap197ec10c-39, col_values=(('external_ids', {'iface-id': '197ec10c-39a4-4c89-b675-b7bb2ee90b1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:24:c8', 'vm-uuid': 'dad9feb1-d5fa-4ed2-9fe3-1573010446f6'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:03 user nova-compute[72426]: INFO os_vif [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39')
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:13:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] No VIF found with MAC fa:16:3e:84:24:c8, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:13:04 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877569.3072762, dad9feb1-d5fa-4ed2-9fe3-1573010446f6 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:04 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] VM Stopped (Lifecycle Event)
Aug 01 08:13:04 user nova-compute[72426]: DEBUG nova.compute.manager [None req-d6f64a8f-0d97-480a-b36b-0ecd888f3ebe None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-3059ec4f-df77-483a-a932-2f598a77c993 req-c35f906e-01f4-423c-abd4-d4ecc2c29fed service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3059ec4f-df77-483a-a932-2f598a77c993 req-c35f906e-01f4-423c-abd4-d4ecc2c29fed service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3059ec4f-df77-483a-a932-2f598a77c993 req-c35f906e-01f4-423c-abd4-d4ecc2c29fed service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3059ec4f-df77-483a-a932-2f598a77c993 req-c35f906e-01f4-423c-abd4-d4ecc2c29fed service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-3059ec4f-df77-483a-a932-2f598a77c993 req-c35f906e-01f4-423c-abd4-d4ecc2c29fed service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:05 user nova-compute[72426]: WARNING nova.compute.manager [req-3059ec4f-df77-483a-a932-2f598a77c993 req-c35f906e-01f4-423c-abd4-d4ecc2c29fed service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state active and task_state resize_finish.
Aug 01 08:13:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877587.3455267, dad9feb1-d5fa-4ed2-9fe3-1573010446f6 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] VM Resumed (Lifecycle Event)
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:13:07 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance running successfully.
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Failed to set time: agent not configured {{(pid=72426) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e0854a18-3866-4e0a-825c-d4c02210e424 tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] finish_migration finished successfully. {{(pid=72426) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ad5107c-1a9d-4b3f-957e-311ecea7dd21 req-511537e5-7257-41b8-b233-1406dffae1df service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ad5107c-1a9d-4b3f-957e-311ecea7dd21 req-511537e5-7257-41b8-b233-1406dffae1df service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ad5107c-1a9d-4b3f-957e-311ecea7dd21 req-511537e5-7257-41b8-b233-1406dffae1df service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ad5107c-1a9d-4b3f-957e-311ecea7dd21 req-511537e5-7257-41b8-b233-1406dffae1df service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ad5107c-1a9d-4b3f-957e-311ecea7dd21 req-511537e5-7257-41b8-b233-1406dffae1df service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:07 user nova-compute[72426]: WARNING nova.compute.manager [req-8ad5107c-1a9d-4b3f-957e-311ecea7dd21 req-511537e5-7257-41b8-b233-1406dffae1df service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state active and task_state resize_finish.
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877587.350308, dad9feb1-d5fa-4ed2-9fe3-1573010446f6 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] VM Started (Lifecycle Event)
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 08:13:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:13:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:13:18 user nova-compute[72426]: INFO nova.compute.claims [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Claim successful on node user
Aug 01 08:13:18 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:13:18 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:13:19 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:13:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:13:19 user nova-compute[72426]: INFO nova.virt.block_device [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Booting with volume d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 at /dev/vda
Aug 01 08:13:19 user nova-compute[72426]: DEBUG os_brick.utils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7395b531-a0e7-45ba-9c41-aff2b5b348fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e582334e-f458-402b-9891-1380c80703c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG nova.policy [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcec51a00543416aa0f5f4b566d1e23e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0680c037a2b4e2ca0cc3cc4cada6e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc787b60-2b0a-4727-9867-72266949b4ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bc85fd-c82d-45e4-956b-6ebf324f3955]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:13:19 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:13:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2eda06-ae07-4cb8-abf4-6ca234aee510]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG os_brick.utils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:13:19 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating existing volume attachment record: 0bece867-7ccb-45e5-832d-1768c0810cca {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:13:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Acquiring lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:13:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:20 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:13:20 user nova-compute[72426]: INFO nova.compute.claims [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Claim successful on node user
Aug 01 08:13:20 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully created port: 712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.872s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:13:21 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:13:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:13:21 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Creating image(s)
Aug 01 08:13:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "/opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "/opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:21 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG nova.policy [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '391a62ae030343ce8f2a36488f410277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b1df9ce60249cea01647895d5692a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.198s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk 1073741824" returned: 0 in 0.060s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully created port: 945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Cannot resize image /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lazy-loading 'migration_context' on Instance uuid 3b0a5550-8c33-4d45-846f-45cfe9fffe67 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Ensure instance console log exists: /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Successfully created port: 664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:13:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully created port: 908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:13:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:25 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:25 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7576MB free_disk=25.778148651123047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:13:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Applying migration context for instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 as it has an incoming, in-progress migration 490eac06-5751-4282-82c7-09b668751b0b. Migration status is finished {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 08:13:25 user nova-compute[72426]: INFO nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating resource usage from migration 490eac06-5751-4282-82c7-09b668751b0b
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 457df7dd-4e0f-4d72-915b-644f0c8588eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance f826ffe7-92dc-4f05-9298-1236513a1af2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance cbe30b5e-a2e4-4f0c-a3af-44125149bfb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Migration 490eac06-5751-4282-82c7-09b668751b0b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance b25da8d6-1222-4856-bda1-e0e51c69f26d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 3b0a5550-8c33-4d45-846f-45cfe9fffe67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Successfully updated port: 664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Acquiring lock "refresh_cache-3b0a5550-8c33-4d45-846f-45cfe9fffe67" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Acquired lock "refresh_cache-3b0a5550-8c33-4d45-846f-45cfe9fffe67" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully created port: 00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-40d249b4-48d9-48bf-b871-709b337cd14e req-f2ac965a-ca25-4f17-8381-c5eb5c264ce3 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Received event network-changed-664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-40d249b4-48d9-48bf-b871-709b337cd14e req-f2ac965a-ca25-4f17-8381-c5eb5c264ce3 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Refreshing instance network info cache due to event network-changed-664c8280-fcb3-4780-9423-3c0da75c7914. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-40d249b4-48d9-48bf-b871-709b337cd14e req-f2ac965a-ca25-4f17-8381-c5eb5c264ce3 service nova] Acquiring lock "refresh_cache-3b0a5550-8c33-4d45-846f-45cfe9fffe67" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:26 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:27 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:13:27 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:13:27 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:13:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:27 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.network.neutron [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Updating instance_info_cache with network_info: [{"id": "664c8280-fcb3-4780-9423-3c0da75c7914", "address": "fa:16:3e:ef:86:bd", "network": {"id": "a908629a-9f6d-4bef-afdc-065c57ef8b04", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "197aa2b20aa8460e817aa3af6d070fcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664c8280-fc", "ovs_interfaceid": "664c8280-fcb3-4780-9423-3c0da75c7914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Releasing lock "refresh_cache-3b0a5550-8c33-4d45-846f-45cfe9fffe67" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Instance network_info: |[{"id": "664c8280-fcb3-4780-9423-3c0da75c7914", "address": "fa:16:3e:ef:86:bd", "network": {"id": "a908629a-9f6d-4bef-afdc-065c57ef8b04", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "197aa2b20aa8460e817aa3af6d070fcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664c8280-fc", "ovs_interfaceid": "664c8280-fcb3-4780-9423-3c0da75c7914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-40d249b4-48d9-48bf-b871-709b337cd14e req-f2ac965a-ca25-4f17-8381-c5eb5c264ce3 service nova] Acquired lock "refresh_cache-3b0a5550-8c33-4d45-846f-45cfe9fffe67" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.network.neutron [req-40d249b4-48d9-48bf-b871-709b337cd14e req-f2ac965a-ca25-4f17-8381-c5eb5c264ce3 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Refreshing network info cache for port 664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Start _get_guest_xml network_info=[{"id": "664c8280-fcb3-4780-9423-3c0da75c7914", "address": "fa:16:3e:ef:86:bd", "network": {"id": "a908629a-9f6d-4bef-afdc-065c57ef8b04", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "197aa2b20aa8460e817aa3af6d070fcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664c8280-fc", "ovs_interfaceid": "664c8280-fcb3-4780-9423-3c0da75c7914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:13:28 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:28 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-500195728',display_name='tempest-VolumesNegativeTest-instance-500195728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-500195728',id=16,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7b1df9ce60249cea01647895d5692a8',ramdisk_id='',reservation_id='r-q0051rkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1735639455',owner_user_name='tempest-VolumesNegativeTest-1735639455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:22Z,user_data=None,user_id='391a62ae030343ce8f2a36488f410277',uuid=3b0a5550-8c33-4d45-846f-45cfe9fffe67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "664c8280-fcb3-4780-9423-3c0da75c7914", "address": "fa:16:3e:ef:86:bd", "network": {"id": "a908629a-9f6d-4bef-afdc-065c57ef8b04", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "197aa2b20aa8460e817aa3af6d070fcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664c8280-fc", "ovs_interfaceid": "664c8280-fcb3-4780-9423-3c0da75c7914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Converting VIF {"id": "664c8280-fcb3-4780-9423-3c0da75c7914", "address": "fa:16:3e:ef:86:bd", "network": {"id": "a908629a-9f6d-4bef-afdc-065c57ef8b04", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "197aa2b20aa8460e817aa3af6d070fcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664c8280-fc", "ovs_interfaceid": "664c8280-fcb3-4780-9423-3c0da75c7914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:bd,bridge_name='br-int',has_traffic_filtering=True,id=664c8280-fcb3-4780-9423-3c0da75c7914,network=Network(a908629a-9f6d-4bef-afdc-065c57ef8b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664c8280-fc') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.objects.instance [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b0a5550-8c33-4d45-846f-45cfe9fffe67 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:28 user nova-compute[72426]: INFO nova.compute.manager [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Rescuing
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquired lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.network.neutron [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:13:28 user nova-compute[72426]:   <uuid>3b0a5550-8c33-4d45-846f-45cfe9fffe67</uuid>
Aug 01 08:13:28 user nova-compute[72426]:   <name>instance-00000010</name>
Aug 01 08:13:28 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:13:28 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:13:28 user nova-compute[72426]:   <metadata>
Aug 01 08:13:28 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:13:28 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:13:28 user nova-compute[72426]:       <nova:name>tempest-VolumesNegativeTest-instance-500195728</nova:name>
Aug 01 08:13:28 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:13:28</nova:creationTime>
Aug 01 08:13:28 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:13:28 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:13:28 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:13:28 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:13:28 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:13:28 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:13:28 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:13:28 user nova-compute[72426]:       <nova:owner>
Aug 01 08:13:28 user nova-compute[72426]:         <nova:user uuid="391a62ae030343ce8f2a36488f410277">tempest-VolumesNegativeTest-1735639455-project-member</nova:user>
Aug 01 08:13:28 user nova-compute[72426]:         <nova:project uuid="f7b1df9ce60249cea01647895d5692a8">tempest-VolumesNegativeTest-1735639455</nova:project>
Aug 01 08:13:28 user nova-compute[72426]:       </nova:owner>
Aug 01 08:13:28 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:13:28 user nova-compute[72426]:       <nova:ports>
Aug 01 08:13:28 user nova-compute[72426]:         <nova:port uuid="664c8280-fcb3-4780-9423-3c0da75c7914">
Aug 01 08:13:28 user nova-compute[72426]:           <nova:ip type="fixed" address="192.168.233.46" ipVersion="4"/>
Aug 01 08:13:28 user nova-compute[72426]:         </nova:port>
Aug 01 08:13:28 user nova-compute[72426]:       </nova:ports>
Aug 01 08:13:28 user nova-compute[72426]:     </nova:instance>
Aug 01 08:13:28 user nova-compute[72426]:   </metadata>
Aug 01 08:13:28 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:13:28 user nova-compute[72426]:     <system>
Aug 01 08:13:28 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:13:28 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:13:28 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:13:28 user nova-compute[72426]:       <entry name="serial">3b0a5550-8c33-4d45-846f-45cfe9fffe67</entry>
Aug 01 08:13:28 user nova-compute[72426]:       <entry name="uuid">3b0a5550-8c33-4d45-846f-45cfe9fffe67</entry>
Aug 01 08:13:28 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:13:28 user nova-compute[72426]:     </system>
Aug 01 08:13:28 user nova-compute[72426]:   </sysinfo>
Aug 01 08:13:28 user nova-compute[72426]:   <os>
Aug 01 08:13:28 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:13:28 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:13:28 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:13:28 user nova-compute[72426]:   </os>
Aug 01 08:13:28 user nova-compute[72426]:   <features>
Aug 01 08:13:28 user nova-compute[72426]:     <acpi/>
Aug 01 08:13:28 user nova-compute[72426]:     <apic/>
Aug 01 08:13:28 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:13:28 user nova-compute[72426]:   </features>
Aug 01 08:13:28 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:13:28 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:13:28 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:13:28 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:13:28 user nova-compute[72426]:   </clock>
Aug 01 08:13:28 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:13:28 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:13:28 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:13:28 user nova-compute[72426]:   </cpu>
Aug 01 08:13:28 user nova-compute[72426]:   <devices>
Aug 01 08:13:28 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:13:28 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:13:28 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk"/>
Aug 01 08:13:28 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:13:28 user nova-compute[72426]:     </disk>
Aug 01 08:13:28 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:13:28 user nova-compute[72426]:       <mac address="fa:16:3e:ef:86:bd"/>
Aug 01 08:13:28 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:28 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:13:28 user nova-compute[72426]:       <target dev="tap664c8280-fc"/>
Aug 01 08:13:28 user nova-compute[72426]:     </interface>
Aug 01 08:13:28 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:13:28 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/console.log" append="off"/>
Aug 01 08:13:28 user nova-compute[72426]:     </serial>
Aug 01 08:13:28 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:13:28 user nova-compute[72426]:     <video>
Aug 01 08:13:28 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:28 user nova-compute[72426]:     </video>
Aug 01 08:13:28 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:13:28 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:13:28 user nova-compute[72426]:     </rng>
Aug 01 08:13:28 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:13:28 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:13:28 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:13:28 user nova-compute[72426]:     </memballoon>
Aug 01 08:13:28 user nova-compute[72426]:   </devices>
Aug 01 08:13:28 user nova-compute[72426]: </domain>
Aug 01 08:13:28 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-500195728',display_name='tempest-VolumesNegativeTest-instance-500195728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-500195728',id=16,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7b1df9ce60249cea01647895d5692a8',ramdisk_id='',reservation_id='r-q0051rkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1735639455',owner_user_name='tempest-VolumesNegativeTest-1735639455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:22Z,user_data=None,user_id='391a62ae030343ce8f2a36488f410277',uuid=3b0a5550-8c33-4d45-846f-45cfe9fffe67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "664c8280-fcb3-4780-9423-3c0da75c7914", "address": "fa:16:3e:ef:86:bd", "network": {"id": "a908629a-9f6d-4bef-afdc-065c57ef8b04", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "197aa2b20aa8460e817aa3af6d070fcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664c8280-fc", "ovs_interfaceid": "664c8280-fcb3-4780-9423-3c0da75c7914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Converting VIF {"id": "664c8280-fcb3-4780-9423-3c0da75c7914", "address": "fa:16:3e:ef:86:bd", "network": {"id": "a908629a-9f6d-4bef-afdc-065c57ef8b04", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "197aa2b20aa8460e817aa3af6d070fcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664c8280-fc", "ovs_interfaceid": "664c8280-fcb3-4780-9423-3c0da75c7914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:bd,bridge_name='br-int',has_traffic_filtering=True,id=664c8280-fcb3-4780-9423-3c0da75c7914,network=Network(a908629a-9f6d-4bef-afdc-065c57ef8b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664c8280-fc') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG os_vif [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:bd,bridge_name='br-int',has_traffic_filtering=True,id=664c8280-fcb3-4780-9423-3c0da75c7914,network=Network(a908629a-9f6d-4bef-afdc-065c57ef8b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664c8280-fc') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap664c8280-fc, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap664c8280-fc, col_values=(('external_ids', {'iface-id': '664c8280-fcb3-4780-9423-3c0da75c7914', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:86:bd', 'vm-uuid': '3b0a5550-8c33-4d45-846f-45cfe9fffe67'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:28 user nova-compute[72426]: INFO os_vif [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:bd,bridge_name='br-int',has_traffic_filtering=True,id=664c8280-fcb3-4780-9423-3c0da75c7914,network=Network(a908629a-9f6d-4bef-afdc-065c57ef8b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664c8280-fc')
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Updating instance_info_cache with network_info: [{"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] No VIF found with MAC fa:16:3e:ef:86:bd, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-457df7dd-4e0f-4d72-915b-644f0c8588eb" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:13:28 user nova-compute[72426]: INFO nova.virt.block_device [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Booting with volume f45a7812-1631-41c8-bc9b-9e51e1a94773 at /dev/vdb
Aug 01 08:13:28 user nova-compute[72426]: DEBUG os_brick.utils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9ba7fb-58e4-4be4-ad20-26ec96953658]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[383b91e7-8f2d-4e01-8d19-ac0f1677a820]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d5feae-7d4b-47cc-9ecc-cf141f907b9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd95fe5-0b46-4811-95e7-a9dc56104249]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:13:28 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:13:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0be05d-651f-4b59-8272-21964f0c23ef]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG os_brick.utils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:13:28 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating existing volume attachment record: ffaf2495-984c-4fd1-83a6-7219b2a1e7c5 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:13:29 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully created port: 78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:13:29 user nova-compute[72426]: DEBUG nova.network.neutron [req-40d249b4-48d9-48bf-b871-709b337cd14e req-f2ac965a-ca25-4f17-8381-c5eb5c264ce3 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Updated VIF entry in instance network info cache for port 664c8280-fcb3-4780-9423-3c0da75c7914. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:13:29 user nova-compute[72426]: DEBUG nova.network.neutron [req-40d249b4-48d9-48bf-b871-709b337cd14e req-f2ac965a-ca25-4f17-8381-c5eb5c264ce3 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Updating instance_info_cache with network_info: [{"id": "664c8280-fcb3-4780-9423-3c0da75c7914", "address": "fa:16:3e:ef:86:bd", "network": {"id": "a908629a-9f6d-4bef-afdc-065c57ef8b04", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "197aa2b20aa8460e817aa3af6d070fcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664c8280-fc", "ovs_interfaceid": "664c8280-fcb3-4780-9423-3c0da75c7914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-40d249b4-48d9-48bf-b871-709b337cd14e req-f2ac965a-ca25-4f17-8381-c5eb5c264ce3 service nova] Releasing lock "refresh_cache-3b0a5550-8c33-4d45-846f-45cfe9fffe67" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:13:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:29 user nova-compute[72426]: DEBUG nova.network.neutron [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updating instance_info_cache with network_info: [{"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Releasing lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully updated port: 712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG nova.compute.manager [req-a240ee0c-99e9-43fb-8546-7950c8a421b4 req-ae8a2141-1d92-476c-b133-967cb2316070 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-changed-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG nova.compute.manager [req-a240ee0c-99e9-43fb-8546-7950c8a421b4 req-ae8a2141-1d92-476c-b133-967cb2316070 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing instance network info cache due to event network-changed-712015d5-a173-4168-a49a-3dba6325ee29. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a240ee0c-99e9-43fb-8546-7950c8a421b4 req-ae8a2141-1d92-476c-b133-967cb2316070 service nova] Acquiring lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a240ee0c-99e9-43fb-8546-7950c8a421b4 req-ae8a2141-1d92-476c-b133-967cb2316070 service nova] Acquired lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG nova.network.neutron [req-a240ee0c-99e9-43fb-8546-7950c8a421b4 req-ae8a2141-1d92-476c-b133-967cb2316070 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing network info cache for port 712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG nova.network.neutron [req-a240ee0c-99e9-43fb-8546-7950c8a421b4 req-ae8a2141-1d92-476c-b133-967cb2316070 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG nova.compute.manager [req-a6d6baea-c20e-4b68-83b9-e147467e8322 req-cb94eb28-2780-4362-ba5e-df605a2f2de8 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Received event network-vif-plugged-664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a6d6baea-c20e-4b68-83b9-e147467e8322 req-cb94eb28-2780-4362-ba5e-df605a2f2de8 service nova] Acquiring lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a6d6baea-c20e-4b68-83b9-e147467e8322 req-cb94eb28-2780-4362-ba5e-df605a2f2de8 service nova] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a6d6baea-c20e-4b68-83b9-e147467e8322 req-cb94eb28-2780-4362-ba5e-df605a2f2de8 service nova] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG nova.compute.manager [req-a6d6baea-c20e-4b68-83b9-e147467e8322 req-cb94eb28-2780-4362-ba5e-df605a2f2de8 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] No waiting events found dispatching network-vif-plugged-664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:30 user nova-compute[72426]: WARNING nova.compute.manager [req-a6d6baea-c20e-4b68-83b9-e147467e8322 req-cb94eb28-2780-4362-ba5e-df605a2f2de8 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Received unexpected event network-vif-plugged-664c8280-fcb3-4780-9423-3c0da75c7914 for instance with vm_state building and task_state spawning.
Aug 01 08:13:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG nova.network.neutron [req-a240ee0c-99e9-43fb-8546-7950c8a421b4 req-ae8a2141-1d92-476c-b133-967cb2316070 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a240ee0c-99e9-43fb-8546-7950c8a421b4 req-ae8a2141-1d92-476c-b133-967cb2316070 service nova] Releasing lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:30 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Instance destroyed successfully.
Aug 01 08:13:30 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Attempting a stable device rescue
Aug 01 08:13:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG nova.compute.manager [req-ebf8f43f-603f-469a-b398-c6547ed7e52e req-480751ca-b9bd-4008-b06d-4bb3c5a98ffb service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-unplugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ebf8f43f-603f-469a-b398-c6547ed7e52e req-480751ca-b9bd-4008-b06d-4bb3c5a98ffb service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ebf8f43f-603f-469a-b398-c6547ed7e52e req-480751ca-b9bd-4008-b06d-4bb3c5a98ffb service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ebf8f43f-603f-469a-b398-c6547ed7e52e req-480751ca-b9bd-4008-b06d-4bb3c5a98ffb service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG nova.compute.manager [req-ebf8f43f-603f-469a-b398-c6547ed7e52e req-480751ca-b9bd-4008-b06d-4bb3c5a98ffb service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-unplugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:31 user nova-compute[72426]: WARNING nova.compute.manager [req-ebf8f43f-603f-469a-b398-c6547ed7e52e req-480751ca-b9bd-4008-b06d-4bb3c5a98ffb service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-unplugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state active and task_state rescuing.
Aug 01 08:13:31 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully updated port: a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72426) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Instance directory exists: not creating {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 08:13:31 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Creating image(s)
Aug 01 08:13:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "/opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "/opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "/opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG nova.objects.instance [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "fc36302004d4bf7191ecd06a29265103dd801b85" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "fc36302004d4bf7191ecd06a29265103dd801b85" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85.part --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-58d0e039-9bf8-4ec4-91f8-b02c50257259 req-0477279a-7048-4ee3-826e-d54e8804ee5c service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-changed-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-58d0e039-9bf8-4ec4-91f8-b02c50257259 req-0477279a-7048-4ee3-826e-d54e8804ee5c service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing instance network info cache due to event network-changed-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58d0e039-9bf8-4ec4-91f8-b02c50257259 req-0477279a-7048-4ee3-826e-d54e8804ee5c service nova] Acquiring lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58d0e039-9bf8-4ec4-91f8-b02c50257259 req-0477279a-7048-4ee3-826e-d54e8804ee5c service nova] Acquired lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.network.neutron [req-58d0e039-9bf8-4ec4-91f8-b02c50257259 req-0477279a-7048-4ee3-826e-d54e8804ee5c service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing network info cache for port a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-f0c04a17-b9ab-44a7-858a-431a8f5d27bc req-259ce294-d53e-4533-9f66-c1e14241ada5 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Received event network-vif-plugged-664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f0c04a17-b9ab-44a7-858a-431a8f5d27bc req-259ce294-d53e-4533-9f66-c1e14241ada5 service nova] Acquiring lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f0c04a17-b9ab-44a7-858a-431a8f5d27bc req-259ce294-d53e-4533-9f66-c1e14241ada5 service nova] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f0c04a17-b9ab-44a7-858a-431a8f5d27bc req-259ce294-d53e-4533-9f66-c1e14241ada5 service nova] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-f0c04a17-b9ab-44a7-858a-431a8f5d27bc req-259ce294-d53e-4533-9f66-c1e14241ada5 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] No waiting events found dispatching network-vif-plugged-664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:32 user nova-compute[72426]: WARNING nova.compute.manager [req-f0c04a17-b9ab-44a7-858a-431a8f5d27bc req-259ce294-d53e-4533-9f66-c1e14241ada5 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Received unexpected event network-vif-plugged-664c8280-fcb3-4780-9423-3c0da75c7914 for instance with vm_state building and task_state spawning.
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully updated port: c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85.part --force-share --output=json" returned: 0 in 0.202s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.network.neutron [req-58d0e039-9bf8-4ec4-91f8-b02c50257259 req-0477279a-7048-4ee3-826e-d54e8804ee5c service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.images [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] 49ef451e-b904-459b-8c9c-0537eb9999e6 was qcow2, converting to raw {{(pid=72426) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85.part /opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85.converted {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877612.711949, 3b0a5550-8c33-4d45-846f-45cfe9fffe67 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:32 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] VM Resumed (Lifecycle Event)
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:13:32 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Instance spawned successfully.
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:32 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877612.7155948, 3b0a5550-8c33-4d45-846f-45cfe9fffe67 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:32 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] VM Started (Lifecycle Event)
Aug 01 08:13:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85.part /opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85.converted" returned: 0 in 0.275s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85.converted --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:33 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:13:33 user nova-compute[72426]: INFO nova.compute.manager [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Took 11.33 seconds to spawn the instance on the hypervisor.
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "fc36302004d4bf7191ecd06a29265103dd801b85" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.719s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "fc36302004d4bf7191ecd06a29265103dd801b85" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "fc36302004d4bf7191ecd06a29265103dd801b85" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:33 user nova-compute[72426]: INFO nova.compute.manager [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Took 12.61 seconds to build instance.
Aug 01 08:13:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fe67bb26-66b0-44e3-914d-445b65a5c2bb tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.765s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85 --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85,backing_fmt=raw /opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/disk.rescue {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-fdd21e34-3ce2-457b-a0ca-b68254d2c902 req-60d7688c-83f9-4b8b-93fd-814086ad43df service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fdd21e34-3ce2-457b-a0ca-b68254d2c902 req-60d7688c-83f9-4b8b-93fd-814086ad43df service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fdd21e34-3ce2-457b-a0ca-b68254d2c902 req-60d7688c-83f9-4b8b-93fd-814086ad43df service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fdd21e34-3ce2-457b-a0ca-b68254d2c902 req-60d7688c-83f9-4b8b-93fd-814086ad43df service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-fdd21e34-3ce2-457b-a0ca-b68254d2c902 req-60d7688c-83f9-4b8b-93fd-814086ad43df service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:33 user nova-compute[72426]: WARNING nova.compute.manager [req-fdd21e34-3ce2-457b-a0ca-b68254d2c902 req-60d7688c-83f9-4b8b-93fd-814086ad43df service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state active and task_state rescuing.
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc36302004d4bf7191ecd06a29265103dd801b85,backing_fmt=raw /opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/disk.rescue" returned: 0 in 0.051s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "fc36302004d4bf7191ecd06a29265103dd801b85" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'migration_context' on Instance uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Start _get_guest_xml network_info=[{"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "vif_mac": "fa:16:3e:9e:6b:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '49ef451e-b904-459b-8c9c-0537eb9999e6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mekxUFXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0efe4ed7-ea8a-485e-b7db-df92ba58f7b6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab6baec9-b9c7-4eb2-8122-1f67cc55672c', 'serial': 'ab6baec9-b9c7-4eb2-8122-1f67cc55672c'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'c823e7d5-96b6-47cc-9211-7826dc965bb5', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'resources' on Instance uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'numa_topology' on Instance uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.network.neutron [req-58d0e039-9bf8-4ec4-91f8-b02c50257259 req-0477279a-7048-4ee3-826e-d54e8804ee5c service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:33 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:33 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58d0e039-9bf8-4ec4-91f8-b02c50257259 req-0477279a-7048-4ee3-826e-d54e8804ee5c service nova] Releasing lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mekxUFXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:13:33 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:13:33 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:13:33 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "2236c44a-562a-4b67-a487-ad51180dbaa0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b114d7-9579-4cd6-bcf1-724d1f09b2b4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = mekxUFXI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 08:13:33 user nova-compute[72426]: node.name = iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c
Aug 01 08:13:33 user nova-compute[72426]: node.tpgt = -1
Aug 01 08:13:33 user nova-compute[72426]: node.startup = automatic
Aug 01 08:13:33 user nova-compute[72426]: node.leading_login = No
Aug 01 08:13:33 user nova-compute[72426]: iface.iscsi_ifacename = default
Aug 01 08:13:33 user nova-compute[72426]: iface.net_ifacename = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.ipaddress = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.prefix_len = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.hwaddress = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.transport_name = tcp
Aug 01 08:13:33 user nova-compute[72426]: iface.initiatorname = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.state = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.vlan_id = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.vlan_priority = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.vlan_state = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.iface_num = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.mtu = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.port = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.bootproto = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.subnet_mask = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.gateway = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.dhcp_alt_client_id = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.dhcp_dns = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.dhcp_learn_iqn = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.dhcp_vendor_id_state = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.dhcp_vendor_id = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.dhcp_slp_da = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.fragmentation = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.gratuitous_arp = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.incoming_forwarding = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.tos_state = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.tos = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.ttl = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.delayed_ack = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.tcp_nagle = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.tcp_wsf_state = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.tcp_wsf = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.tcp_timer_scale = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.tcp_timestamp = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.redirect = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.def_task_mgmt_timeout = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.header_digest = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.data_digest = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.immediate_data = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.initial_r2t = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.data_seq_inorder = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.data_pdu_inorder = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.erl = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.max_receive_data_len = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.first_burst_len = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.max_outstanding_r2t = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.max_burst_len = 0
Aug 01 08:13:33 user nova-compute[72426]: iface.chap_auth = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.bidi_chap = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.strict_login_compliance = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.discovery_auth = <empty>
Aug 01 08:13:33 user nova-compute[72426]: iface.discovery_logout = <empty>
Aug 01 08:13:33 user nova-compute[72426]: node.discovery_address = <empty>
Aug 01 08:13:33 user nova-compute[72426]: node.discovery_port = 0
Aug 01 08:13:33 user nova-compute[72426]: node.discovery_type = static
Aug 01 08:13:33 user nova-compute[72426]: node.session.initial_cmdsn = 0
Aug 01 08:13:33 user nova-compute[72426]: node.session.initial_login_retry_max = 8
Aug 01 08:13:33 user nova-compute[72426]: node.session.xmit_thread_priority = -20
Aug 01 08:13:33 user nova-compute[72426]: node.session.cmds_max = 128
Aug 01 08:13:33 user nova-compute[72426]: node.session.queue_depth = 32
Aug 01 08:13:33 user nova-compute[72426]: node.session.nr_sessions = 1
Aug 01 08:13:33 user nova-compute[72426]: node.session.auth.authmethod = CHAP
Aug 01 08:13:33 user nova-compute[72426]: node.session.auth.username = mekxUFXI
Aug 01 08:13:33 user nova-compute[72426]: node.session.auth.password = ***
Aug 01 08:13:33 user nova-compute[72426]: node.session.auth.username_in = <empty>
Aug 01 08:13:33 user nova-compute[72426]: node.session.auth.password_in = <empty>
Aug 01 08:13:33 user nova-compute[72426]: node.session.auth.chap_algs = MD5
Aug 01 08:13:33 user nova-compute[72426]: node.session.timeo.replacement_timeout = 120
Aug 01 08:13:33 user nova-compute[72426]: node.session.err_timeo.abort_timeout = 15
Aug 01 08:13:33 user nova-compute[72426]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 08:13:33 user nova-compute[72426]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 08:13:33 user nova-compute[72426]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 08:13:33 user nova-compute[72426]: node.session.iscsi.FastAbort = Yes
Aug 01 08:13:33 user nova-compute[72426]: node.session.iscsi.InitialR2T = No
Aug 01 08:13:33 user nova-compute[72426]: node.session.iscsi.ImmediateData = Yes
Aug 01 08:13:33 user nova-compute[72426]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 08:13:33 user nova-compute[72426]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 08:13:33 user nova-compute[72426]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 08:13:33 user nova-compute[72426]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 08:13:33 user nova-compute[72426]: node.session.iscsi.MaxConnections = 1
Aug 01 08:13:33 user nova-compute[72426]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 08:13:33 user nova-compute[72426]: node.session.iscsi.ERL = 0
Aug 01 08:13:33 user nova-compute[72426]: node.session.scan = manual
Aug 01 08:13:33 user nova-compute[72426]: node.session.reopen_max = 0
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].address = 172.16.0.220
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].port = 3260
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].startup = manual
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].tcp.window_size = 524288
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].tcp.type_of_service = 0
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].timeo.logout_timeout = 15
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].timeo.login_timeout = 15
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].timeo.auth_timeout = 45
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].iscsi.DataDigest = None
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].iscsi.IFMarker = No
Aug 01 08:13:33 user nova-compute[72426]: node.conn[0].iscsi.OFMarker = No
Aug 01 08:13:33 user nova-compute[72426]: # END RECORD
Aug 01 08:13:33 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[94580565-3046-4892-91f2-274acea2d8d9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eac366-3eb8-4cce-99a8-1404d0a1045e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mekxUFXI {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mekxUFXI" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0978c272-5ef2-4c8e-9f83-661a64759176]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mekxUFXI'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6436193f-9710-463c-9365-695a57d35935]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:13:33 user nova-compute[72426]: INFO nova.compute.claims [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Claim successful on node user
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90e1e7a-bb26-4f49-9102-7983f3d2fc98]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:33 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:33 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:33 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:33 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:33 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:33 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:33 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:33 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.210s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] HCTL ('33', '0', '0', 0) found on session 11 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[279fecb6-4541-44e4-a012-d52b09418883]: (4, ('0 0 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching for a device in session 11 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mekxUFXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.244s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] <== connect_volume: return (246ms) {'type': 'block', 'scsi_wwn': '23231613339663464', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231613339663464', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1277733807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1277733807',id=12,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:12:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-pq9iq1e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:12:05Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=0efe4ed7-ea8a-485e-b7db-df92ba58f7b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "vif_mac": "fa:16:3e:9e:6b:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "vif_mac": "fa:16:3e:9e:6b:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6b:07,bridge_name='br-int',has_traffic_filtering=True,id=2ab312e8-542a-48ce-992f-055264f86613,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab312e8-54') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'pci_devices' on Instance uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully updated port: 945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:13:33 user nova-compute[72426]:   <uuid>0efe4ed7-ea8a-485e-b7db-df92ba58f7b6</uuid>
Aug 01 08:13:33 user nova-compute[72426]:   <name>instance-0000000c</name>
Aug 01 08:13:33 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:13:33 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:13:33 user nova-compute[72426]:   <metadata>
Aug 01 08:13:33 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:13:33 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:13:33 user nova-compute[72426]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1277733807</nova:name>
Aug 01 08:13:33 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:13:33</nova:creationTime>
Aug 01 08:13:33 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:13:33 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:13:33 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:13:33 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:13:33 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:13:33 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:13:33 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:13:33 user nova-compute[72426]:       <nova:owner>
Aug 01 08:13:33 user nova-compute[72426]:         <nova:user uuid="184d71425948492e835ea8f0dd857d1f">tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member</nova:user>
Aug 01 08:13:33 user nova-compute[72426]:         <nova:project uuid="d0b6971ed0a343468f071e1e25c27d5b">tempest-ServerBootFromVolumeStableRescueTest-2030640431</nova:project>
Aug 01 08:13:33 user nova-compute[72426]:       </nova:owner>
Aug 01 08:13:33 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:13:33 user nova-compute[72426]:       <nova:ports>
Aug 01 08:13:33 user nova-compute[72426]:         <nova:port uuid="2ab312e8-542a-48ce-992f-055264f86613">
Aug 01 08:13:33 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 08:13:33 user nova-compute[72426]:         </nova:port>
Aug 01 08:13:33 user nova-compute[72426]:       </nova:ports>
Aug 01 08:13:33 user nova-compute[72426]:     </nova:instance>
Aug 01 08:13:33 user nova-compute[72426]:   </metadata>
Aug 01 08:13:33 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:13:33 user nova-compute[72426]:     <system>
Aug 01 08:13:33 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:13:33 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:13:33 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:13:33 user nova-compute[72426]:       <entry name="serial">0efe4ed7-ea8a-485e-b7db-df92ba58f7b6</entry>
Aug 01 08:13:33 user nova-compute[72426]:       <entry name="uuid">0efe4ed7-ea8a-485e-b7db-df92ba58f7b6</entry>
Aug 01 08:13:33 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:13:33 user nova-compute[72426]:     </system>
Aug 01 08:13:33 user nova-compute[72426]:   </sysinfo>
Aug 01 08:13:33 user nova-compute[72426]:   <os>
Aug 01 08:13:33 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:13:33 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:13:33 user nova-compute[72426]:   </os>
Aug 01 08:13:33 user nova-compute[72426]:   <features>
Aug 01 08:13:33 user nova-compute[72426]:     <acpi/>
Aug 01 08:13:33 user nova-compute[72426]:     <apic/>
Aug 01 08:13:33 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:13:33 user nova-compute[72426]:   </features>
Aug 01 08:13:33 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:13:33 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:13:33 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:13:33 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:13:33 user nova-compute[72426]:   </clock>
Aug 01 08:13:33 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:13:33 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:13:33 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:13:33 user nova-compute[72426]:   </cpu>
Aug 01 08:13:33 user nova-compute[72426]:   <devices>
Aug 01 08:13:33 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:13:33 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:13:33 user nova-compute[72426]:       <source dev="/dev/sdb"/>
Aug 01 08:13:33 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:13:33 user nova-compute[72426]:       <serial>ab6baec9-b9c7-4eb2-8122-1f67cc55672c</serial>
Aug 01 08:13:33 user nova-compute[72426]:     </disk>
Aug 01 08:13:33 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:13:33 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:13:33 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/disk.rescue"/>
Aug 01 08:13:33 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:13:33 user nova-compute[72426]:       <boot order="1"/>
Aug 01 08:13:33 user nova-compute[72426]:     </disk>
Aug 01 08:13:33 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:13:33 user nova-compute[72426]:       <mac address="fa:16:3e:9e:6b:07"/>
Aug 01 08:13:33 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:33 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:13:33 user nova-compute[72426]:       <target dev="tap2ab312e8-54"/>
Aug 01 08:13:33 user nova-compute[72426]:     </interface>
Aug 01 08:13:33 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:13:33 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/console.log" append="off"/>
Aug 01 08:13:33 user nova-compute[72426]:     </serial>
Aug 01 08:13:33 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:13:33 user nova-compute[72426]:     <video>
Aug 01 08:13:33 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:33 user nova-compute[72426]:     </video>
Aug 01 08:13:33 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:13:33 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:13:33 user nova-compute[72426]:     </rng>
Aug 01 08:13:33 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:13:33 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:13:33 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:13:33 user nova-compute[72426]:     </memballoon>
Aug 01 08:13:33 user nova-compute[72426]:   </devices>
Aug 01 08:13:33 user nova-compute[72426]: </domain>
Aug 01 08:13:33 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:13:33 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Instance destroyed successfully.
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:13:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No VIF found with MAC fa:16:3e:9e:6b:07, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.713s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-changed-c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing instance network info cache due to event network-changed-c68cd240-bcb2-4864-96ed-697b41cfc678. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] Acquiring lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] Acquired lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing network info cache for port c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:13:34 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:13:34 user nova-compute[72426]: INFO nova.virt.block_device [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Booting with volume ea7f2fb7-3db8-441c-820e-774209ec96d4 at /dev/vda
Aug 01 08:13:34 user nova-compute[72426]: DEBUG os_brick.utils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f37c9f8-c750-4b7f-83a1-fafc03f03a50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf8a467-2ffa-4ab9-9858-ba95c630d9a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca4a9bf-d8ee-4411-b80a-4b4957a26221]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[815aa0ff-c046-4393-a78d-51a95b854284]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:13:34 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[53444e44-5176-4313-9ca7-1e5b93ef9da6]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG os_brick.utils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Updating existing volume attachment record: b312e7da-e20a-4918-b4c1-fd0f8343fbb1 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] Releasing lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-changed-945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing instance network info cache due to event network-changed-945a82f8-68fd-49bb-90de-95156e45e7d2. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] Acquiring lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] Acquired lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing network info cache for port 945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG nova.policy [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49f9ffcf2a8a435a968fd41590d90607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f71856fa7cb47b998a77b3f4ba436d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-75d37032-d49b-4eee-8d06-30c5a0386f0b req-e25dc091-f24a-4914-b881-7c423fae8fb6 service nova] Releasing lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-a010d9ee-b59b-4f66-b87a-b3a9faa16dca req-d8e8f5ad-4adc-4f1e-afbb-64db35386b1d service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a010d9ee-b59b-4f66-b87a-b3a9faa16dca req-d8e8f5ad-4adc-4f1e-afbb-64db35386b1d service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a010d9ee-b59b-4f66-b87a-b3a9faa16dca req-d8e8f5ad-4adc-4f1e-afbb-64db35386b1d service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a010d9ee-b59b-4f66-b87a-b3a9faa16dca req-d8e8f5ad-4adc-4f1e-afbb-64db35386b1d service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-a010d9ee-b59b-4f66-b87a-b3a9faa16dca req-d8e8f5ad-4adc-4f1e-afbb-64db35386b1d service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:35 user nova-compute[72426]: WARNING nova.compute.manager [req-a010d9ee-b59b-4f66-b87a-b3a9faa16dca req-d8e8f5ad-4adc-4f1e-afbb-64db35386b1d service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state active and task_state rescuing.
Aug 01 08:13:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully updated port: 908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-6e5cd913-67fe-4503-a75c-7d4ec32d1a2a req-ea680dff-8712-47df-af94-304d770cf6ce service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-changed-908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-6e5cd913-67fe-4503-a75c-7d4ec32d1a2a req-ea680dff-8712-47df-af94-304d770cf6ce service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing instance network info cache due to event network-changed-908eab8b-6159-4a32-85e7-2ee9d9e25899. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6e5cd913-67fe-4503-a75c-7d4ec32d1a2a req-ea680dff-8712-47df-af94-304d770cf6ce service nova] Acquiring lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6e5cd913-67fe-4503-a75c-7d4ec32d1a2a req-ea680dff-8712-47df-af94-304d770cf6ce service nova] Acquired lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:36 user nova-compute[72426]: DEBUG nova.network.neutron [req-6e5cd913-67fe-4503-a75c-7d4ec32d1a2a req-ea680dff-8712-47df-af94-304d770cf6ce service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing network info cache for port 908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:37 user nova-compute[72426]: DEBUG nova.network.neutron [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Successfully created port: af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:13:37 user nova-compute[72426]: DEBUG nova.network.neutron [req-6e5cd913-67fe-4503-a75c-7d4ec32d1a2a req-ea680dff-8712-47df-af94-304d770cf6ce service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:37 user nova-compute[72426]: DEBUG nova.network.neutron [req-6e5cd913-67fe-4503-a75c-7d4ec32d1a2a req-ea680dff-8712-47df-af94-304d770cf6ce service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6e5cd913-67fe-4503-a75c-7d4ec32d1a2a req-ea680dff-8712-47df-af94-304d770cf6ce service nova] Releasing lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:37 user nova-compute[72426]: DEBUG nova.compute.manager [req-8e18fe4c-56b6-438c-a8ea-de5f38fa82f1 req-30105a49-e412-4b5a-98fc-42526bcac28e service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8e18fe4c-56b6-438c-a8ea-de5f38fa82f1 req-30105a49-e412-4b5a-98fc-42526bcac28e service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8e18fe4c-56b6-438c-a8ea-de5f38fa82f1 req-30105a49-e412-4b5a-98fc-42526bcac28e service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8e18fe4c-56b6-438c-a8ea-de5f38fa82f1 req-30105a49-e412-4b5a-98fc-42526bcac28e service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:37 user nova-compute[72426]: DEBUG nova.compute.manager [req-8e18fe4c-56b6-438c-a8ea-de5f38fa82f1 req-30105a49-e412-4b5a-98fc-42526bcac28e service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:37 user nova-compute[72426]: WARNING nova.compute.manager [req-8e18fe4c-56b6-438c-a8ea-de5f38fa82f1 req-30105a49-e412-4b5a-98fc-42526bcac28e service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state active and task_state rescuing.
Aug 01 08:13:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:13:38 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877618.1184678, 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:38 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] VM Resumed (Lifecycle Event)
Aug 01 08:13:38 user nova-compute[72426]: DEBUG nova.compute.manager [None req-5bf44a7f-0211-4d4c-b422-e79cd2b74a07 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:38 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:38 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:38 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 08:13:38 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877618.1338418, 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:38 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] VM Started (Lifecycle Event)
Aug 01 08:13:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:38 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:38 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully updated port: 00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:38 user nova-compute[72426]: INFO nova.virt.block_device [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Booting with volume 29e6bc04-cc7d-4d25-a11a-476d1c180c0c at /dev/vdc
Aug 01 08:13:39 user nova-compute[72426]: DEBUG os_brick.utils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914262d-2c35-4db1-9f76-6c7a1230d697]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e65b73-7f68-4f6a-8267-1fc6118d7cc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[665a7a74-f2ee-4852-af7c-0b9a117fffda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c759df5-321c-4ac6-8447-88768c0fd97b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:13:39 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eb1813-1941-4456-8a40-d464503a1198]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG os_brick.utils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating existing volume attachment record: e366fd91-3620-4b23-a7e9-64c9b5fb1300 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG nova.compute.manager [req-d7e60722-d272-4ac2-b715-e550e0695b31 req-d57b04bf-68b5-4045-9d90-b05f8a25fc3c service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-changed-00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG nova.compute.manager [req-d7e60722-d272-4ac2-b715-e550e0695b31 req-d57b04bf-68b5-4045-9d90-b05f8a25fc3c service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing instance network info cache due to event network-changed-00b3a3d4-37ae-44d5-9279-7327e46a8d4f. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d7e60722-d272-4ac2-b715-e550e0695b31 req-d57b04bf-68b5-4045-9d90-b05f8a25fc3c service nova] Acquiring lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d7e60722-d272-4ac2-b715-e550e0695b31 req-d57b04bf-68b5-4045-9d90-b05f8a25fc3c service nova] Acquired lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG nova.network.neutron [req-d7e60722-d272-4ac2-b715-e550e0695b31 req-d57b04bf-68b5-4045-9d90-b05f8a25fc3c service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing network info cache for port 00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG nova.network.neutron [req-d7e60722-d272-4ac2-b715-e550e0695b31 req-d57b04bf-68b5-4045-9d90-b05f8a25fc3c service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Successfully updated port: af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "refresh_cache-2236c44a-562a-4b67-a487-ad51180dbaa0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquired lock "refresh_cache-2236c44a-562a-4b67-a487-ad51180dbaa0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG nova.network.neutron [req-d7e60722-d272-4ac2-b715-e550e0695b31 req-d57b04bf-68b5-4045-9d90-b05f8a25fc3c service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d7e60722-d272-4ac2-b715-e550e0695b31 req-d57b04bf-68b5-4045-9d90-b05f8a25fc3c service nova] Releasing lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Updating instance_info_cache with network_info: [{"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Releasing lock "refresh_cache-2236c44a-562a-4b67-a487-ad51180dbaa0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Instance network_info: |[{"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:13:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Successfully updated port: 78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquired lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:13:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:41 user nova-compute[72426]: DEBUG nova.compute.manager [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received event network-changed-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:41 user nova-compute[72426]: DEBUG nova.compute.manager [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Refreshing instance network info cache due to event network-changed-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] Acquiring lock "refresh_cache-2236c44a-562a-4b67-a487-ad51180dbaa0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] Acquired lock "refresh_cache-2236c44a-562a-4b67-a487-ad51180dbaa0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:41 user nova-compute[72426]: DEBUG nova.network.neutron [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Refreshing network info cache for port af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:42 user nova-compute[72426]: DEBUG nova.network.neutron [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Updated VIF entry in instance network info cache for port af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:13:42 user nova-compute[72426]: DEBUG nova.network.neutron [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Updating instance_info_cache with network_info: [{"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] Releasing lock "refresh_cache-2236c44a-562a-4b67-a487-ad51180dbaa0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:42 user nova-compute[72426]: DEBUG nova.compute.manager [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-changed-78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:42 user nova-compute[72426]: DEBUG nova.compute.manager [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing instance network info cache due to event network-changed-78781ae1-af5d-477b-a44c-85d53d08c755. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] Acquiring lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [{"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Releasing lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance network_info: |[{"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:13:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] Acquired lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:43 user nova-compute[72426]: DEBUG nova.network.neutron [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing network info cache for port 78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:13:44 user nova-compute[72426]: INFO nova.compute.claims [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Claim successful on node user
Aug 01 08:13:44 user nova-compute[72426]: DEBUG nova.network.neutron [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updated VIF entry in instance network info cache for port 78781ae1-af5d-477b-a44c-85d53d08c755. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG nova.network.neutron [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [{"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8a2e13c-20f2-4e1e-8094-4c295a92fe2e req-66996614-eea8-4fac-8ffe-f73c6b9cb1b3 service nova] Releasing lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:13:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:13:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.policy [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e024ff90ae7148819d1d518d3754733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9024541f804b259eeed3f2dd0ce12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:13:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Creating image(s)
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:13:45 user nova-compute[72426]: INFO nova.compute.claims [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Claim successful on node user
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk 1073741824" returned: 0 in 0.049s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.160s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Cannot resize image /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'migration_context' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Ensure instance console log exists: /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.738s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:13:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:13:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Creating image(s)
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Successfully created port: 2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.policy [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e024ff90ae7148819d1d518d3754733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9024541f804b259eeed3f2dd0ce12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.169s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.130s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk 1073741824" returned: 0 in 0.049s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Cannot resize image /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'migration_context' on Instance uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Ensure instance console log exists: /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:47 user nova-compute[72426]: DEBUG nova.network.neutron [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Successfully created port: de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:13:47 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Successfully updated port: 2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquired lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:47 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:13:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-edd0b1bf-06d2-4580-9c39-94f8faabbdaf req-feb3384b-186b-45ff-ba54-0dda30201be2 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-changed-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-edd0b1bf-06d2-4580-9c39-94f8faabbdaf req-feb3384b-186b-45ff-ba54-0dda30201be2 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Refreshing instance network info cache due to event network-changed-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-edd0b1bf-06d2-4580-9c39-94f8faabbdaf req-feb3384b-186b-45ff-ba54-0dda30201be2 service nova] Acquiring lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:47 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updating instance_info_cache with network_info: [{"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Releasing lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Instance network_info: |[{"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-edd0b1bf-06d2-4580-9c39-94f8faabbdaf req-feb3384b-186b-45ff-ba54-0dda30201be2 service nova] Acquired lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.network.neutron [req-edd0b1bf-06d2-4580-9c39-94f8faabbdaf req-feb3384b-186b-45ff-ba54-0dda30201be2 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Refreshing network info cache for port 2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Start _get_guest_xml network_info=[{"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:13:48 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:48 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-606882209',display_name='tempest-ServerRescueNegativeTestJSON-server-606882209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-606882209',id=18,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-u9xaq11k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:45Z,user_data=None,user_id='e024ff90ae7148819d1d518d3754733f',uuid=a48d957c-264f-4d4f-a3b7-54e287f606dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:c7,bridge_name='br-int',has_traffic_filtering=True,id=2b6e1a0b-eb3e-4071-80a3-227777cfa5d7,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e1a0b-eb') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'pci_devices' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:13:48 user nova-compute[72426]:   <uuid>a48d957c-264f-4d4f-a3b7-54e287f606dd</uuid>
Aug 01 08:13:48 user nova-compute[72426]:   <name>instance-00000012</name>
Aug 01 08:13:48 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:13:48 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:13:48 user nova-compute[72426]:   <metadata>
Aug 01 08:13:48 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:13:48 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:13:48 user nova-compute[72426]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-606882209</nova:name>
Aug 01 08:13:48 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:13:48</nova:creationTime>
Aug 01 08:13:48 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:13:48 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:13:48 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:13:48 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:13:48 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:13:48 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:13:48 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:13:48 user nova-compute[72426]:       <nova:owner>
Aug 01 08:13:48 user nova-compute[72426]:         <nova:user uuid="e024ff90ae7148819d1d518d3754733f">tempest-ServerRescueNegativeTestJSON-1267015268-project-member</nova:user>
Aug 01 08:13:48 user nova-compute[72426]:         <nova:project uuid="ba9024541f804b259eeed3f2dd0ce12f">tempest-ServerRescueNegativeTestJSON-1267015268</nova:project>
Aug 01 08:13:48 user nova-compute[72426]:       </nova:owner>
Aug 01 08:13:48 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:13:48 user nova-compute[72426]:       <nova:ports>
Aug 01 08:13:48 user nova-compute[72426]:         <nova:port uuid="2b6e1a0b-eb3e-4071-80a3-227777cfa5d7">
Aug 01 08:13:48 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 08:13:48 user nova-compute[72426]:         </nova:port>
Aug 01 08:13:48 user nova-compute[72426]:       </nova:ports>
Aug 01 08:13:48 user nova-compute[72426]:     </nova:instance>
Aug 01 08:13:48 user nova-compute[72426]:   </metadata>
Aug 01 08:13:48 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:13:48 user nova-compute[72426]:     <system>
Aug 01 08:13:48 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:13:48 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:13:48 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:13:48 user nova-compute[72426]:       <entry name="serial">a48d957c-264f-4d4f-a3b7-54e287f606dd</entry>
Aug 01 08:13:48 user nova-compute[72426]:       <entry name="uuid">a48d957c-264f-4d4f-a3b7-54e287f606dd</entry>
Aug 01 08:13:48 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:13:48 user nova-compute[72426]:     </system>
Aug 01 08:13:48 user nova-compute[72426]:   </sysinfo>
Aug 01 08:13:48 user nova-compute[72426]:   <os>
Aug 01 08:13:48 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:13:48 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:13:48 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:13:48 user nova-compute[72426]:   </os>
Aug 01 08:13:48 user nova-compute[72426]:   <features>
Aug 01 08:13:48 user nova-compute[72426]:     <acpi/>
Aug 01 08:13:48 user nova-compute[72426]:     <apic/>
Aug 01 08:13:48 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:13:48 user nova-compute[72426]:   </features>
Aug 01 08:13:48 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:13:48 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:13:48 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:13:48 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:13:48 user nova-compute[72426]:   </clock>
Aug 01 08:13:48 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:13:48 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:13:48 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:13:48 user nova-compute[72426]:   </cpu>
Aug 01 08:13:48 user nova-compute[72426]:   <devices>
Aug 01 08:13:48 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:13:48 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:13:48 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk"/>
Aug 01 08:13:48 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:13:48 user nova-compute[72426]:     </disk>
Aug 01 08:13:48 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:13:48 user nova-compute[72426]:       <mac address="fa:16:3e:24:e2:c7"/>
Aug 01 08:13:48 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:48 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:13:48 user nova-compute[72426]:       <target dev="tap2b6e1a0b-eb"/>
Aug 01 08:13:48 user nova-compute[72426]:     </interface>
Aug 01 08:13:48 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:13:48 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/console.log" append="off"/>
Aug 01 08:13:48 user nova-compute[72426]:     </serial>
Aug 01 08:13:48 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:13:48 user nova-compute[72426]:     <video>
Aug 01 08:13:48 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:48 user nova-compute[72426]:     </video>
Aug 01 08:13:48 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:13:48 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:13:48 user nova-compute[72426]:     </rng>
Aug 01 08:13:48 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:13:48 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:13:48 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:13:48 user nova-compute[72426]:     </memballoon>
Aug 01 08:13:48 user nova-compute[72426]:   </devices>
Aug 01 08:13:48 user nova-compute[72426]: </domain>
Aug 01 08:13:48 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-606882209',display_name='tempest-ServerRescueNegativeTestJSON-server-606882209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-606882209',id=18,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-u9xaq11k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:45Z,user_data=None,user_id='e024ff90ae7148819d1d518d3754733f',uuid=a48d957c-264f-4d4f-a3b7-54e287f606dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:c7,bridge_name='br-int',has_traffic_filtering=True,id=2b6e1a0b-eb3e-4071-80a3-227777cfa5d7,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e1a0b-eb') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG os_vif [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:c7,bridge_name='br-int',has_traffic_filtering=True,id=2b6e1a0b-eb3e-4071-80a3-227777cfa5d7,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e1a0b-eb') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b6e1a0b-eb, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b6e1a0b-eb, col_values=(('external_ids', {'iface-id': '2b6e1a0b-eb3e-4071-80a3-227777cfa5d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:e2:c7', 'vm-uuid': 'a48d957c-264f-4d4f-a3b7-54e287f606dd'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:48 user nova-compute[72426]: INFO os_vif [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:c7,bridge_name='br-int',has_traffic_filtering=True,id=2b6e1a0b-eb3e-4071-80a3-227777cfa5d7,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e1a0b-eb')
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No VIF found with MAC fa:16:3e:24:e2:c7, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Successfully updated port: de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquired lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:13:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-edd0b1bf-06d2-4580-9c39-94f8faabbdaf req-feb3384b-186b-45ff-ba54-0dda30201be2 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updated VIF entry in instance network info cache for port 2b6e1a0b-eb3e-4071-80a3-227777cfa5d7. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-edd0b1bf-06d2-4580-9c39-94f8faabbdaf req-feb3384b-186b-45ff-ba54-0dda30201be2 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updating instance_info_cache with network_info: [{"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-edd0b1bf-06d2-4580-9c39-94f8faabbdaf req-feb3384b-186b-45ff-ba54-0dda30201be2 service nova] Releasing lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Updating instance_info_cache with network_info: [{"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Releasing lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Instance network_info: |[{"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Start _get_guest_xml network_info=[{"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:13:49 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:49 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308070890',display_name='tempest-ServerRescueNegativeTestJSON-server-1308070890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308070890',id=19,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-zdo8fa50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:46Z,user_data=None,user_id='e024ff90ae7148819d1d518d3754733f',uuid=bbb82852-01b7-4609-95a3-f8f36cebbf7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:b6:08,bridge_name='br-int',has_traffic_filtering=True,id=de38d532-38d7-42b6-92cd-1c65a2d551b1,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde38d532-38') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.objects.instance [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'pci_devices' on Instance uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:13:49 user nova-compute[72426]:   <uuid>bbb82852-01b7-4609-95a3-f8f36cebbf7d</uuid>
Aug 01 08:13:49 user nova-compute[72426]:   <name>instance-00000013</name>
Aug 01 08:13:49 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:13:49 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:13:49 user nova-compute[72426]:   <metadata>
Aug 01 08:13:49 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:13:49 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:13:49 user nova-compute[72426]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1308070890</nova:name>
Aug 01 08:13:49 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:13:49</nova:creationTime>
Aug 01 08:13:49 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:13:49 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:13:49 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:13:49 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:13:49 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:13:49 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:13:49 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:13:49 user nova-compute[72426]:       <nova:owner>
Aug 01 08:13:49 user nova-compute[72426]:         <nova:user uuid="e024ff90ae7148819d1d518d3754733f">tempest-ServerRescueNegativeTestJSON-1267015268-project-member</nova:user>
Aug 01 08:13:49 user nova-compute[72426]:         <nova:project uuid="ba9024541f804b259eeed3f2dd0ce12f">tempest-ServerRescueNegativeTestJSON-1267015268</nova:project>
Aug 01 08:13:49 user nova-compute[72426]:       </nova:owner>
Aug 01 08:13:49 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:13:49 user nova-compute[72426]:       <nova:ports>
Aug 01 08:13:49 user nova-compute[72426]:         <nova:port uuid="de38d532-38d7-42b6-92cd-1c65a2d551b1">
Aug 01 08:13:49 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 08:13:49 user nova-compute[72426]:         </nova:port>
Aug 01 08:13:49 user nova-compute[72426]:       </nova:ports>
Aug 01 08:13:49 user nova-compute[72426]:     </nova:instance>
Aug 01 08:13:49 user nova-compute[72426]:   </metadata>
Aug 01 08:13:49 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:13:49 user nova-compute[72426]:     <system>
Aug 01 08:13:49 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:13:49 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:13:49 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:13:49 user nova-compute[72426]:       <entry name="serial">bbb82852-01b7-4609-95a3-f8f36cebbf7d</entry>
Aug 01 08:13:49 user nova-compute[72426]:       <entry name="uuid">bbb82852-01b7-4609-95a3-f8f36cebbf7d</entry>
Aug 01 08:13:49 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:13:49 user nova-compute[72426]:     </system>
Aug 01 08:13:49 user nova-compute[72426]:   </sysinfo>
Aug 01 08:13:49 user nova-compute[72426]:   <os>
Aug 01 08:13:49 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:13:49 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:13:49 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:13:49 user nova-compute[72426]:   </os>
Aug 01 08:13:49 user nova-compute[72426]:   <features>
Aug 01 08:13:49 user nova-compute[72426]:     <acpi/>
Aug 01 08:13:49 user nova-compute[72426]:     <apic/>
Aug 01 08:13:49 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:13:49 user nova-compute[72426]:   </features>
Aug 01 08:13:49 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:13:49 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:13:49 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:13:49 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:13:49 user nova-compute[72426]:   </clock>
Aug 01 08:13:49 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:13:49 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:13:49 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:13:49 user nova-compute[72426]:   </cpu>
Aug 01 08:13:49 user nova-compute[72426]:   <devices>
Aug 01 08:13:49 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:13:49 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:13:49 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk"/>
Aug 01 08:13:49 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:13:49 user nova-compute[72426]:     </disk>
Aug 01 08:13:49 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:13:49 user nova-compute[72426]:       <mac address="fa:16:3e:64:b6:08"/>
Aug 01 08:13:49 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:49 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:13:49 user nova-compute[72426]:       <target dev="tapde38d532-38"/>
Aug 01 08:13:49 user nova-compute[72426]:     </interface>
Aug 01 08:13:49 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:13:49 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/console.log" append="off"/>
Aug 01 08:13:49 user nova-compute[72426]:     </serial>
Aug 01 08:13:49 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:13:49 user nova-compute[72426]:     <video>
Aug 01 08:13:49 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:49 user nova-compute[72426]:     </video>
Aug 01 08:13:49 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:13:49 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:13:49 user nova-compute[72426]:     </rng>
Aug 01 08:13:49 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:13:49 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:13:49 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:13:49 user nova-compute[72426]:     </memballoon>
Aug 01 08:13:49 user nova-compute[72426]:   </devices>
Aug 01 08:13:49 user nova-compute[72426]: </domain>
Aug 01 08:13:49 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308070890',display_name='tempest-ServerRescueNegativeTestJSON-server-1308070890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308070890',id=19,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-zdo8fa50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:46Z,user_data=None,user_id='e024ff90ae7148819d1d518d3754733f',uuid=bbb82852-01b7-4609-95a3-f8f36cebbf7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:b6:08,bridge_name='br-int',has_traffic_filtering=True,id=de38d532-38d7-42b6-92cd-1c65a2d551b1,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde38d532-38') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG os_vif [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b6:08,bridge_name='br-int',has_traffic_filtering=True,id=de38d532-38d7-42b6-92cd-1c65a2d551b1,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde38d532-38') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde38d532-38, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde38d532-38, col_values=(('external_ids', {'iface-id': 'de38d532-38d7-42b6-92cd-1c65a2d551b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:b6:08', 'vm-uuid': 'bbb82852-01b7-4609-95a3-f8f36cebbf7d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:49 user nova-compute[72426]: INFO os_vif [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b6:08,bridge_name='br-int',has_traffic_filtering=True,id=de38d532-38d7-42b6-92cd-1c65a2d551b1,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde38d532-38')
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No VIF found with MAC fa:16:3e:64:b6:08, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-6d1e0e13-799a-4037-9fbe-67dad4cf0868 req-25c7710f-5a5b-4cdd-af15-903f94590e98 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-changed-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-6d1e0e13-799a-4037-9fbe-67dad4cf0868 req-25c7710f-5a5b-4cdd-af15-903f94590e98 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Refreshing instance network info cache due to event network-changed-de38d532-38d7-42b6-92cd-1c65a2d551b1. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6d1e0e13-799a-4037-9fbe-67dad4cf0868 req-25c7710f-5a5b-4cdd-af15-903f94590e98 service nova] Acquiring lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6d1e0e13-799a-4037-9fbe-67dad4cf0868 req-25c7710f-5a5b-4cdd-af15-903f94590e98 service nova] Acquired lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:13:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-6d1e0e13-799a-4037-9fbe-67dad4cf0868 req-25c7710f-5a5b-4cdd-af15-903f94590e98 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Refreshing network info cache for port de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-6d1e0e13-799a-4037-9fbe-67dad4cf0868 req-25c7710f-5a5b-4cdd-af15-903f94590e98 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Updated VIF entry in instance network info cache for port de38d532-38d7-42b6-92cd-1c65a2d551b1. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-6d1e0e13-799a-4037-9fbe-67dad4cf0868 req-25c7710f-5a5b-4cdd-af15-903f94590e98 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Updating instance_info_cache with network_info: [{"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6d1e0e13-799a-4037-9fbe-67dad4cf0868 req-25c7710f-5a5b-4cdd-af15-903f94590e98 service nova] Releasing lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-1848ca53-ec3c-487a-9409-438576bbf228 req-ab850a47-648a-42ab-b59b-c23ea0451b6a service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1848ca53-ec3c-487a-9409-438576bbf228 req-ab850a47-648a-42ab-b59b-c23ea0451b6a service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1848ca53-ec3c-487a-9409-438576bbf228 req-ab850a47-648a-42ab-b59b-c23ea0451b6a service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1848ca53-ec3c-487a-9409-438576bbf228 req-ab850a47-648a-42ab-b59b-c23ea0451b6a service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-1848ca53-ec3c-487a-9409-438576bbf228 req-ab850a47-648a-42ab-b59b-c23ea0451b6a service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:50 user nova-compute[72426]: WARNING nova.compute.manager [req-1848ca53-ec3c-487a-9409-438576bbf228 req-ab850a47-648a-42ab-b59b-c23ea0451b6a service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state building and task_state spawning.
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.compute.manager [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:13:51 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Creating image(s)
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Ensure instance console log exists: /opt/stack/data/nova/instances/2236c44a-562a-4b67-a487-ad51180dbaa0/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Start _get_guest_xml network_info=[{"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WexjNtdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2236c44a-562a-4b67-a487-ad51180dbaa0', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea7f2fb7-3db8-441c-820e-774209ec96d4', 'serial': 'ea7f2fb7-3db8-441c-820e-774209ec96d4'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'b312e7da-e20a-4918-b4c1-fd0f8343fbb1', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:51 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:51 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WexjNtdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:13:51 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:13:51 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:13:51 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:13:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2038760c-651d-45c5-9e2f-6224326dbe88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:13:51 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[15467a0a-06cb-4f42-8921-1032c515a228]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4] added
Aug 01 08:13:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8430eca7-5ddd-43ac-8b7f-90ed0d17b5be]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d490d68-b293-4f90-96d4-faf1c6d84b13]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WexjNtdk {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WexjNtdk" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[56672b00-91b2-4f7e-87bd-d137c315ef6d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WexjNtdk'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f0ddd8-f639-419d-bc1b-c71ff200a0b9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d51bafc-00ac-49f1-8450-8d2be7574313]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1398e37e-13d0-40eb-932f-90925558f713]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4, portal: 172.16.0.220,3260]
Aug 01 08:13:51 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4, portal: 172.16.0.220,3260] successful.
Aug 01 08:13:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9f05ca-b742-42d0-ad60-e01de1fc6699]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbb07a7-9fe1-4128-a30c-ec488b7f392c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:13:51 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfab3af9-73f6-4a26-8941-048f55ff988f]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WexjNtdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-bdd62233-8acb-4d7f-95f3-7d29e6a91bbc req-5cb1d74d-f870-4a63-a2ad-0dc3c9e9bce9 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bdd62233-8acb-4d7f-95f3-7d29e6a91bbc req-5cb1d74d-f870-4a63-a2ad-0dc3c9e9bce9 service nova] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bdd62233-8acb-4d7f-95f3-7d29e6a91bbc req-5cb1d74d-f870-4a63-a2ad-0dc3c9e9bce9 service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bdd62233-8acb-4d7f-95f3-7d29e6a91bbc req-5cb1d74d-f870-4a63-a2ad-0dc3c9e9bce9 service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-bdd62233-8acb-4d7f-95f3-7d29e6a91bbc req-5cb1d74d-f870-4a63-a2ad-0dc3c9e9bce9 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] No waiting events found dispatching network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:52 user nova-compute[72426]: WARNING nova.compute.manager [req-bdd62233-8acb-4d7f-95f3-7d29e6a91bbc req-5cb1d74d-f870-4a63-a2ad-0dc3c9e9bce9 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received unexpected event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 for instance with vm_state building and task_state spawning.
Aug 01 08:13:52 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26537393733376234', 'path': '/dev/sde'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537393733376234', 'path': '/dev/sde'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-341757131',display_name='tempest-TestVolumeBootPattern-volume-backed-server-341757131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-341757131',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMGZaN1lEFO6+rTNjzYnu6rCae9yCftdCKtYwzyd9FepVghLyLJYRUTnmRrxttix1Ja0VLEB5bTGBxv05NQ4g4oZNP2fJrAf4C6Ll7BeT6s5F2ME6+PgvJgPN5A2X5usQ==',key_name='tempest-keypair-858649081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-rtxswdf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=2236c44a-562a-4b67-a487-ad51180dbaa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6e4e5a-78') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.objects.instance [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lazy-loading 'pci_devices' on Instance uuid 2236c44a-562a-4b67-a487-ad51180dbaa0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:13:52 user nova-compute[72426]:   <uuid>2236c44a-562a-4b67-a487-ad51180dbaa0</uuid>
Aug 01 08:13:52 user nova-compute[72426]:   <name>instance-00000011</name>
Aug 01 08:13:52 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:13:52 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:13:52 user nova-compute[72426]:   <metadata>
Aug 01 08:13:52 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:13:52 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:13:52 user nova-compute[72426]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-341757131</nova:name>
Aug 01 08:13:52 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:13:51</nova:creationTime>
Aug 01 08:13:52 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:13:52 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:13:52 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:13:52 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:13:52 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:13:52 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:13:52 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:13:52 user nova-compute[72426]:       <nova:owner>
Aug 01 08:13:52 user nova-compute[72426]:         <nova:user uuid="49f9ffcf2a8a435a968fd41590d90607">tempest-TestVolumeBootPattern-942085866-project-member</nova:user>
Aug 01 08:13:52 user nova-compute[72426]:         <nova:project uuid="6f71856fa7cb47b998a77b3f4ba436d7">tempest-TestVolumeBootPattern-942085866</nova:project>
Aug 01 08:13:52 user nova-compute[72426]:       </nova:owner>
Aug 01 08:13:52 user nova-compute[72426]:       <nova:ports>
Aug 01 08:13:52 user nova-compute[72426]:         <nova:port uuid="af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9">
Aug 01 08:13:52 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 08:13:52 user nova-compute[72426]:         </nova:port>
Aug 01 08:13:52 user nova-compute[72426]:       </nova:ports>
Aug 01 08:13:52 user nova-compute[72426]:     </nova:instance>
Aug 01 08:13:52 user nova-compute[72426]:   </metadata>
Aug 01 08:13:52 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:13:52 user nova-compute[72426]:     <system>
Aug 01 08:13:52 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:13:52 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:13:52 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:13:52 user nova-compute[72426]:       <entry name="serial">2236c44a-562a-4b67-a487-ad51180dbaa0</entry>
Aug 01 08:13:52 user nova-compute[72426]:       <entry name="uuid">2236c44a-562a-4b67-a487-ad51180dbaa0</entry>
Aug 01 08:13:52 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:13:52 user nova-compute[72426]:     </system>
Aug 01 08:13:52 user nova-compute[72426]:   </sysinfo>
Aug 01 08:13:52 user nova-compute[72426]:   <os>
Aug 01 08:13:52 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:13:52 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:13:52 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:13:52 user nova-compute[72426]:   </os>
Aug 01 08:13:52 user nova-compute[72426]:   <features>
Aug 01 08:13:52 user nova-compute[72426]:     <acpi/>
Aug 01 08:13:52 user nova-compute[72426]:     <apic/>
Aug 01 08:13:52 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:13:52 user nova-compute[72426]:   </features>
Aug 01 08:13:52 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:13:52 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:13:52 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:13:52 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:13:52 user nova-compute[72426]:   </clock>
Aug 01 08:13:52 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:13:52 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:13:52 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:13:52 user nova-compute[72426]:   </cpu>
Aug 01 08:13:52 user nova-compute[72426]:   <devices>
Aug 01 08:13:52 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:13:52 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:13:52 user nova-compute[72426]:       <source dev="/dev/sde"/>
Aug 01 08:13:52 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:13:52 user nova-compute[72426]:       <serial>ea7f2fb7-3db8-441c-820e-774209ec96d4</serial>
Aug 01 08:13:52 user nova-compute[72426]:     </disk>
Aug 01 08:13:52 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:13:52 user nova-compute[72426]:       <mac address="fa:16:3e:0f:b1:42"/>
Aug 01 08:13:52 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:52 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:13:52 user nova-compute[72426]:       <target dev="tapaf6e4e5a-78"/>
Aug 01 08:13:52 user nova-compute[72426]:     </interface>
Aug 01 08:13:52 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:13:52 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/2236c44a-562a-4b67-a487-ad51180dbaa0/console.log" append="off"/>
Aug 01 08:13:52 user nova-compute[72426]:     </serial>
Aug 01 08:13:52 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:13:52 user nova-compute[72426]:     <video>
Aug 01 08:13:52 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:13:52 user nova-compute[72426]:     </video>
Aug 01 08:13:52 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:13:52 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:13:52 user nova-compute[72426]:     </rng>
Aug 01 08:13:52 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:13:52 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:13:52 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:13:52 user nova-compute[72426]:     </memballoon>
Aug 01 08:13:52 user nova-compute[72426]:   </devices>
Aug 01 08:13:52 user nova-compute[72426]: </domain>
Aug 01 08:13:52 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-341757131',display_name='tempest-TestVolumeBootPattern-volume-backed-server-341757131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-341757131',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMGZaN1lEFO6+rTNjzYnu6rCae9yCftdCKtYwzyd9FepVghLyLJYRUTnmRrxttix1Ja0VLEB5bTGBxv05NQ4g4oZNP2fJrAf4C6Ll7BeT6s5F2ME6+PgvJgPN5A2X5usQ==',key_name='tempest-keypair-858649081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-rtxswdf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=2236c44a-562a-4b67-a487-ad51180dbaa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6e4e5a-78') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG os_vif [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6e4e5a-78') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf6e4e5a-78, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf6e4e5a-78, col_values=(('external_ids', {'iface-id': 'af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:b1:42', 'vm-uuid': '2236c44a-562a-4b67-a487-ad51180dbaa0'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:52 user nova-compute[72426]: INFO os_vif [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6e4e5a-78')
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] No VIF found with MAC fa:16:3e:0f:b1:42, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-00b10a9e-5490-4ec4-900a-d05b9cb6bb08 req-8c37fe93-4c0f-4f7b-882d-dd74376b1927 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-00b10a9e-5490-4ec4-900a-d05b9cb6bb08 req-8c37fe93-4c0f-4f7b-882d-dd74376b1927 service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-00b10a9e-5490-4ec4-900a-d05b9cb6bb08 req-8c37fe93-4c0f-4f7b-882d-dd74376b1927 service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-00b10a9e-5490-4ec4-900a-d05b9cb6bb08 req-8c37fe93-4c0f-4f7b-882d-dd74376b1927 service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-00b10a9e-5490-4ec4-900a-d05b9cb6bb08 req-8c37fe93-4c0f-4f7b-882d-dd74376b1927 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:52 user nova-compute[72426]: WARNING nova.compute.manager [req-00b10a9e-5490-4ec4-900a-d05b9cb6bb08 req-8c37fe93-4c0f-4f7b-882d-dd74376b1927 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state building and task_state spawning.
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877633.8687418, a48d957c-264f-4d4f-a3b7-54e287f606dd => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] VM Resumed (Lifecycle Event)
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:13:53 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Instance spawned successfully.
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877633.8703, a48d957c-264f-4d4f-a3b7-54e287f606dd => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] VM Started (Lifecycle Event)
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877634.0055213, bbb82852-01b7-4609-95a3-f8f36cebbf7d => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:54 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] VM Resumed (Lifecycle Event)
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:13:54 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Instance spawned successfully.
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:54 user nova-compute[72426]: INFO nova.compute.manager [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Took 8.96 seconds to spawn the instance on the hypervisor.
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:54 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877634.007342, bbb82852-01b7-4609-95a3-f8f36cebbf7d => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:54 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] VM Started (Lifecycle Event)
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-b541b0ff-5b2a-47a5-899d-c42a5697ae21 req-d870d3d0-e075-4316-ad48-6cc0d164eb2e service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b541b0ff-5b2a-47a5-899d-c42a5697ae21 req-d870d3d0-e075-4316-ad48-6cc0d164eb2e service nova] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b541b0ff-5b2a-47a5-899d-c42a5697ae21 req-d870d3d0-e075-4316-ad48-6cc0d164eb2e service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b541b0ff-5b2a-47a5-899d-c42a5697ae21 req-d870d3d0-e075-4316-ad48-6cc0d164eb2e service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-b541b0ff-5b2a-47a5-899d-c42a5697ae21 req-d870d3d0-e075-4316-ad48-6cc0d164eb2e service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] No waiting events found dispatching network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:54 user nova-compute[72426]: WARNING nova.compute.manager [req-b541b0ff-5b2a-47a5-899d-c42a5697ae21 req-d870d3d0-e075-4316-ad48-6cc0d164eb2e service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received unexpected event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 for instance with vm_state building and task_state spawning.
Aug 01 08:13:54 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:13:54 user nova-compute[72426]: INFO nova.compute.manager [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Took 8.02 seconds to spawn the instance on the hypervisor.
Aug 01 08:13:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:54 user nova-compute[72426]: INFO nova.compute.manager [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Took 10.11 seconds to build instance.
Aug 01 08:13:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f96e6490-4fd8-45aa-b8e8-cd05340fd512 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.244s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:54 user nova-compute[72426]: INFO nova.compute.manager [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Took 9.19 seconds to build instance.
Aug 01 08:13:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-304c7d5d-16eb-48bd-88b8-451b48afd962 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.371s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received event network-vif-plugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] Acquiring lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] No waiting events found dispatching network-vif-plugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:56 user nova-compute[72426]: WARNING nova.compute.manager [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received unexpected event network-vif-plugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 for instance with vm_state building and task_state spawning.
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received event network-vif-plugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] Acquiring lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] No waiting events found dispatching network-vif-plugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:13:56 user nova-compute[72426]: WARNING nova.compute.manager [req-852e1c79-bd27-4644-98b6-7fb874532d2a req-06ea0c93-5346-470f-9d4b-b0cf1ba3cdd5 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received unexpected event network-vif-plugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 for instance with vm_state building and task_state spawning.
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877636.6104743, 2236c44a-562a-4b67-a487-ad51180dbaa0 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:56 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] VM Resumed (Lifecycle Event)
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:13:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Instance spawned successfully.
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:13:56 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877636.614789, 2236c44a-562a-4b67-a487-ad51180dbaa0 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:13:56 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] VM Started (Lifecycle Event)
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:13:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:56 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:13:56 user nova-compute[72426]: INFO nova.compute.manager [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Took 5.64 seconds to spawn the instance on the hypervisor.
Aug 01 08:13:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:13:56 user nova-compute[72426]: INFO nova.compute.manager [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Took 23.29 seconds to build instance.
Aug 01 08:13:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-5e7cdb52-eeaf-4b35-9c92-be02d1367842 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.430s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:13:57 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Creating image(s)
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Ensure instance console log exists: /opt/stack/data/nova/instances/b25da8d6-1222-4856-bda1-e0e51c69f26d/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Start _get_guest_xml network_info=[{"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSdQjkJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b25da8d6-1222-4856-bda1-e0e51c69f26d', 'attached_at': '', 'detached_at': '', 'volume_id': 'd89fb433-18d0-42d0-a5d1-fd2e9f9a4049', 'serial': 'd89fb433-18d0-42d0-a5d1-fd2e9f9a4049'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '0bece867-7ccb-45e5-832d-1768c0810cca', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QfEVqZCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b25da8d6-1222-4856-bda1-e0e51c69f26d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f45a7812-1631-41c8-bc9b-9e51e1a94773', 'serial': 'f45a7812-1631-41c8-bc9b-9e51e1a94773'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'ffaf2495-984c-4fd1-83a6-7219b2a1e7c5', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDKBtrOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b25da8d6-1222-4856-bda1-e0e51c69f26d', 'attached_at': '', 'detached_at': '', 'volume_id': '29e6bc04-cc7d-4d25-a11a-476d1c180c0c', 'serial': '29e6bc04-cc7d-4d25-a11a-476d1c180c0c'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'e366fd91-3620-4b23-a7e9-64c9b5fb1300', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:13:57 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:57 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSdQjkJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:13:57 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:13:57 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:13:57 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91d464a-e688-4f3b-9e9d-7129d442ee93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:13:57 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[526f6f43-f111-4be1-a394-20c787b7d13d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049] added
Aug 01 08:13:57 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c24769-4f59-4f14-a8f7-c87a363d0880]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d50774-ba7a-4b87-b986-17b148772a5b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSdQjkJs {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSdQjkJs" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c220a1e-671c-4273-a6bb-e1d0ef185773]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSdQjkJs'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[da24ff1f-b946-42f5-963d-35ae6c9fdc41]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c8d6fb-48aa-492e-ab05-b481f5712687]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac53050-5339-463c-a1f8-e10061ca70a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049, portal: 172.16.0.220,3260]
Aug 01 08:13:57 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049, portal: 172.16.0.220,3260] successful.
Aug 01 08:13:57 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb59dcaf-d051-4f6a-8c13-965629e00902]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[455c4913-20f6-4f6f-93c7-ceb192628501]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:57 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[048e0eeb-25e0-427e-992b-718bc169f243]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:13:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSdQjkJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23564343838333561', 'path': '/dev/sdf'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564343838333561', 'path': '/dev/sdf'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QfEVqZCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:13:58 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:13:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:13:58 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:13:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:13:58 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64b8027-118a-4578-affe-2098798bd09d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:13:58 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0704ed44-76e9-4d6b-a734-d45bd493fdad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773] added
Aug 01 08:13:58 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc48de03-5b2b-4119-8ef5-558fd65cee53]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e815db58-0f90-47d2-9088-f4f4612f1d25]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QfEVqZCg {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QfEVqZCg" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaf6d53-9f4e-4725-84ff-a82cf3e8ae05]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QfEVqZCg'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1f0adc-e107-4516-b83a-6f8b7c0ba978]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f17736c-f252-4cc9-95b0-634a78c75f4a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d404633e-e0a8-4499-848c-a6403210cec4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773, portal: 172.16.0.220,3260]
Aug 01 08:13:59 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773, portal: 172.16.0.220,3260] successful.
Aug 01 08:13:59 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3c5ac-1b4a-4b78-8f99-557f7426fdf7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c2b145-ab59-475c-bfd4-1d4480008103]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:13:59 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e850df22-5d28-4f09-91b5-b546ead212f5]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:13:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QfEVqZCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '26238656539393239', 'path': '/dev/sdh'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238656539393239', 'path': '/dev/sdh'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDKBtrOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:14:00 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:14:00 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:14:00 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9163d0-c742-435b-9503-eb7d81080e27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:14:00 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a6cd1b-a7e4-4c28-9157-06946b44a2fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c] added
Aug 01 08:14:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e207b9-d902-4183-9cd1-36461b703f4e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc79813b-8884-4478-87e0-d6402f215e09]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oDKBtrOf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oDKBtrOf" returned: 0 in 0.036s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8315f9f0-ec46-41b8-b92f-6d371d4ae217]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oDKBtrOf'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7e1baa-bf6b-4186-91a3-bb5e2a2aa702]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd64845-b15a-4c4f-92d0-06c5098374c5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[714872ab-c3e4-4000-9352-bf27ed0f5ad5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c, portal: 172.16.0.220,3260]
Aug 01 08:14:00 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c, portal: 172.16.0.220,3260] successful.
Aug 01 08:14:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[642b55ba-8b7c-443e-92f7-017a0e90249d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede53eb5-46db-46b4-8f98-6f8b18a22f4d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:14:00 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:14:00 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] HCTL ('40', '-', '-', 0) found on session 19 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fff796-6924-4b8c-80ca-964d92c78638]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Searching for a device in session 19 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:14:00 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDKBtrOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '23361323739343230', 'path': '/dev/sdi'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361323739343230', 'path': '/dev/sdi'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=712015d5-a173-4168-a49a-3dba6325ee29,network=Network(d160d631-7152-4cc8-97a7-2dd060e809bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712015d5-a1') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:14,bridge_name='br-int',has_traffic_filtering=True,id=a6d9f738-9b7c-49bf-8ae2-2bbbd4214036,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6d9f738-9b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:26:8d,bridge_name='br-int',has_traffic_filtering=True,id=c68cd240-bcb2-4864-96ed-697b41cfc678,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc68cd240-bc') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f3:79,bridge_name='br-int',has_traffic_filtering=True,id=945a82f8-68fd-49bb-90de-95156e45e7d2,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945a82f8-68') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d8:ef,bridge_name='br-int',has_traffic_filtering=True,id=908eab8b-6159-4a32-85e7-2ee9d9e25899,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eab8b-61') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:82:60,bridge_name='br-int',has_traffic_filtering=True,id=00b3a3d4-37ae-44d5-9279-7327e46a8d4f,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3a3d4-37') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9e:6e,bridge_name='br-int',has_traffic_filtering=True,id=78781ae1-af5d-477b-a44c-85d53d08c755,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78781ae1-af') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.objects.instance [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lazy-loading 'pci_devices' on Instance uuid b25da8d6-1222-4856-bda1-e0e51c69f26d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:14:01 user nova-compute[72426]:   <uuid>b25da8d6-1222-4856-bda1-e0e51c69f26d</uuid>
Aug 01 08:14:01 user nova-compute[72426]:   <name>instance-0000000f</name>
Aug 01 08:14:01 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:14:01 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:14:01 user nova-compute[72426]:   <metadata>
Aug 01 08:14:01 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:14:01 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:14:01 user nova-compute[72426]:       <nova:name>tempest-device-tagging-server-1171221622</nova:name>
Aug 01 08:14:01 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:13:57</nova:creationTime>
Aug 01 08:14:01 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:14:01 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:14:01 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:14:01 user nova-compute[72426]:       <nova:owner>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:user uuid="fcec51a00543416aa0f5f4b566d1e23e">tempest-TaggedBootDevicesTest_v242-837970744-project-member</nova:user>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:project uuid="e0680c037a2b4e2ca0cc3cc4cada6e11">tempest-TaggedBootDevicesTest_v242-837970744</nova:project>
Aug 01 08:14:01 user nova-compute[72426]:       </nova:owner>
Aug 01 08:14:01 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:14:01 user nova-compute[72426]:       <nova:ports>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:port uuid="712015d5-a173-4168-a49a-3dba6325ee29">
Aug 01 08:14:01 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 08:14:01 user nova-compute[72426]:         </nova:port>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:port uuid="a6d9f738-9b7c-49bf-8ae2-2bbbd4214036">
Aug 01 08:14:01 user nova-compute[72426]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Aug 01 08:14:01 user nova-compute[72426]:         </nova:port>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:port uuid="c68cd240-bcb2-4864-96ed-697b41cfc678">
Aug 01 08:14:01 user nova-compute[72426]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Aug 01 08:14:01 user nova-compute[72426]:         </nova:port>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:port uuid="945a82f8-68fd-49bb-90de-95156e45e7d2">
Aug 01 08:14:01 user nova-compute[72426]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Aug 01 08:14:01 user nova-compute[72426]:         </nova:port>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:port uuid="908eab8b-6159-4a32-85e7-2ee9d9e25899">
Aug 01 08:14:01 user nova-compute[72426]:           <nova:ip type="fixed" address="10.1.1.127" ipVersion="4"/>
Aug 01 08:14:01 user nova-compute[72426]:         </nova:port>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:port uuid="00b3a3d4-37ae-44d5-9279-7327e46a8d4f">
Aug 01 08:14:01 user nova-compute[72426]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 08:14:01 user nova-compute[72426]:         </nova:port>
Aug 01 08:14:01 user nova-compute[72426]:         <nova:port uuid="78781ae1-af5d-477b-a44c-85d53d08c755">
Aug 01 08:14:01 user nova-compute[72426]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 08:14:01 user nova-compute[72426]:         </nova:port>
Aug 01 08:14:01 user nova-compute[72426]:       </nova:ports>
Aug 01 08:14:01 user nova-compute[72426]:     </nova:instance>
Aug 01 08:14:01 user nova-compute[72426]:   </metadata>
Aug 01 08:14:01 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:14:01 user nova-compute[72426]:     <system>
Aug 01 08:14:01 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:14:01 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:14:01 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:14:01 user nova-compute[72426]:       <entry name="serial">b25da8d6-1222-4856-bda1-e0e51c69f26d</entry>
Aug 01 08:14:01 user nova-compute[72426]:       <entry name="uuid">b25da8d6-1222-4856-bda1-e0e51c69f26d</entry>
Aug 01 08:14:01 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:14:01 user nova-compute[72426]:     </system>
Aug 01 08:14:01 user nova-compute[72426]:   </sysinfo>
Aug 01 08:14:01 user nova-compute[72426]:   <os>
Aug 01 08:14:01 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:14:01 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:14:01 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:14:01 user nova-compute[72426]:   </os>
Aug 01 08:14:01 user nova-compute[72426]:   <features>
Aug 01 08:14:01 user nova-compute[72426]:     <acpi/>
Aug 01 08:14:01 user nova-compute[72426]:     <apic/>
Aug 01 08:14:01 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:14:01 user nova-compute[72426]:   </features>
Aug 01 08:14:01 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:14:01 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:14:01 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:14:01 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:14:01 user nova-compute[72426]:   </clock>
Aug 01 08:14:01 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:14:01 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:14:01 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:14:01 user nova-compute[72426]:   </cpu>
Aug 01 08:14:01 user nova-compute[72426]:   <devices>
Aug 01 08:14:01 user nova-compute[72426]:     <disk type="file" device="cdrom">
Aug 01 08:14:01 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 08:14:01 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/b25da8d6-1222-4856-bda1-e0e51c69f26d/disk.config"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="hda" bus="ide"/>
Aug 01 08:14:01 user nova-compute[72426]:     </disk>
Aug 01 08:14:01 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:14:01 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:14:01 user nova-compute[72426]:       <source dev="/dev/sdf"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:       <serial>d89fb433-18d0-42d0-a5d1-fd2e9f9a4049</serial>
Aug 01 08:14:01 user nova-compute[72426]:     </disk>
Aug 01 08:14:01 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:14:01 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:14:01 user nova-compute[72426]:       <source dev="/dev/sdh"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:       <serial>f45a7812-1631-41c8-bc9b-9e51e1a94773</serial>
Aug 01 08:14:01 user nova-compute[72426]:     </disk>
Aug 01 08:14:01 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:14:01 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:14:01 user nova-compute[72426]:       <source dev="/dev/sdi"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="vdc" bus="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:       <serial>29e6bc04-cc7d-4d25-a11a-476d1c180c0c</serial>
Aug 01 08:14:01 user nova-compute[72426]:     </disk>
Aug 01 08:14:01 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:14:01 user nova-compute[72426]:       <mac address="fa:16:3e:ef:36:7c"/>
Aug 01 08:14:01 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="tap712015d5-a1"/>
Aug 01 08:14:01 user nova-compute[72426]:     </interface>
Aug 01 08:14:01 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:14:01 user nova-compute[72426]:       <mac address="fa:16:3e:74:c3:14"/>
Aug 01 08:14:01 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="tapa6d9f738-9b"/>
Aug 01 08:14:01 user nova-compute[72426]:     </interface>
Aug 01 08:14:01 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:14:01 user nova-compute[72426]:       <mac address="fa:16:3e:90:26:8d"/>
Aug 01 08:14:01 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="tapc68cd240-bc"/>
Aug 01 08:14:01 user nova-compute[72426]:     </interface>
Aug 01 08:14:01 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:14:01 user nova-compute[72426]:       <mac address="fa:16:3e:5e:f3:79"/>
Aug 01 08:14:01 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="tap945a82f8-68"/>
Aug 01 08:14:01 user nova-compute[72426]:     </interface>
Aug 01 08:14:01 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:14:01 user nova-compute[72426]:       <mac address="fa:16:3e:0d:d8:ef"/>
Aug 01 08:14:01 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="tap908eab8b-61"/>
Aug 01 08:14:01 user nova-compute[72426]:     </interface>
Aug 01 08:14:01 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:14:01 user nova-compute[72426]:       <mac address="fa:16:3e:6a:82:60"/>
Aug 01 08:14:01 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="tap00b3a3d4-37"/>
Aug 01 08:14:01 user nova-compute[72426]:     </interface>
Aug 01 08:14:01 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:14:01 user nova-compute[72426]:       <mac address="fa:16:3e:6f:9e:6e"/>
Aug 01 08:14:01 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:14:01 user nova-compute[72426]:       <target dev="tap78781ae1-af"/>
Aug 01 08:14:01 user nova-compute[72426]:     </interface>
Aug 01 08:14:01 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:14:01 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/b25da8d6-1222-4856-bda1-e0e51c69f26d/console.log" append="off"/>
Aug 01 08:14:01 user nova-compute[72426]:     </serial>
Aug 01 08:14:01 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:14:01 user nova-compute[72426]:     <video>
Aug 01 08:14:01 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:14:01 user nova-compute[72426]:     </video>
Aug 01 08:14:01 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:14:01 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:14:01 user nova-compute[72426]:     </rng>
Aug 01 08:14:01 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:14:01 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:14:01 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:14:01 user nova-compute[72426]:     </memballoon>
Aug 01 08:14:01 user nova-compute[72426]:   </devices>
Aug 01 08:14:01 user nova-compute[72426]: </domain>
Aug 01 08:14:01 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=712015d5-a173-4168-a49a-3dba6325ee29,network=Network(d160d631-7152-4cc8-97a7-2dd060e809bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712015d5-a1') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=712015d5-a173-4168-a49a-3dba6325ee29,network=Network(d160d631-7152-4cc8-97a7-2dd060e809bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712015d5-a1') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap712015d5-a1, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap712015d5-a1, col_values=(('external_ids', {'iface-id': '712015d5-a173-4168-a49a-3dba6325ee29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:36:7c', 'vm-uuid': 'b25da8d6-1222-4856-bda1-e0e51c69f26d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: INFO os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=712015d5-a173-4168-a49a-3dba6325ee29,network=Network(d160d631-7152-4cc8-97a7-2dd060e809bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712015d5-a1')
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:14,bridge_name='br-int',has_traffic_filtering=True,id=a6d9f738-9b7c-49bf-8ae2-2bbbd4214036,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6d9f738-9b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:14,bridge_name='br-int',has_traffic_filtering=True,id=a6d9f738-9b7c-49bf-8ae2-2bbbd4214036,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6d9f738-9b') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6d9f738-9b, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6d9f738-9b, col_values=(('external_ids', {'iface-id': 'a6d9f738-9b7c-49bf-8ae2-2bbbd4214036', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:c3:14', 'vm-uuid': 'b25da8d6-1222-4856-bda1-e0e51c69f26d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: INFO os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:14,bridge_name='br-int',has_traffic_filtering=True,id=a6d9f738-9b7c-49bf-8ae2-2bbbd4214036,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6d9f738-9b')
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:26:8d,bridge_name='br-int',has_traffic_filtering=True,id=c68cd240-bcb2-4864-96ed-697b41cfc678,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc68cd240-bc') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:26:8d,bridge_name='br-int',has_traffic_filtering=True,id=c68cd240-bcb2-4864-96ed-697b41cfc678,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc68cd240-bc') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc68cd240-bc, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc68cd240-bc, col_values=(('external_ids', {'iface-id': 'c68cd240-bcb2-4864-96ed-697b41cfc678', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:26:8d', 'vm-uuid': 'b25da8d6-1222-4856-bda1-e0e51c69f26d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: INFO os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:26:8d,bridge_name='br-int',has_traffic_filtering=True,id=c68cd240-bcb2-4864-96ed-697b41cfc678,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc68cd240-bc')
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f3:79,bridge_name='br-int',has_traffic_filtering=True,id=945a82f8-68fd-49bb-90de-95156e45e7d2,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945a82f8-68') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f3:79,bridge_name='br-int',has_traffic_filtering=True,id=945a82f8-68fd-49bb-90de-95156e45e7d2,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945a82f8-68') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap945a82f8-68, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap945a82f8-68, col_values=(('external_ids', {'iface-id': '945a82f8-68fd-49bb-90de-95156e45e7d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:f3:79', 'vm-uuid': 'b25da8d6-1222-4856-bda1-e0e51c69f26d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: INFO os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f3:79,bridge_name='br-int',has_traffic_filtering=True,id=945a82f8-68fd-49bb-90de-95156e45e7d2,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945a82f8-68')
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d8:ef,bridge_name='br-int',has_traffic_filtering=True,id=908eab8b-6159-4a32-85e7-2ee9d9e25899,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eab8b-61') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d8:ef,bridge_name='br-int',has_traffic_filtering=True,id=908eab8b-6159-4a32-85e7-2ee9d9e25899,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eab8b-61') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap908eab8b-61, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap908eab8b-61, col_values=(('external_ids', {'iface-id': '908eab8b-6159-4a32-85e7-2ee9d9e25899', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:d8:ef', 'vm-uuid': 'b25da8d6-1222-4856-bda1-e0e51c69f26d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: INFO os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d8:ef,bridge_name='br-int',has_traffic_filtering=True,id=908eab8b-6159-4a32-85e7-2ee9d9e25899,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eab8b-61')
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:82:60,bridge_name='br-int',has_traffic_filtering=True,id=00b3a3d4-37ae-44d5-9279-7327e46a8d4f,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3a3d4-37') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:82:60,bridge_name='br-int',has_traffic_filtering=True,id=00b3a3d4-37ae-44d5-9279-7327e46a8d4f,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3a3d4-37') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00b3a3d4-37, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00b3a3d4-37, col_values=(('external_ids', {'iface-id': '00b3a3d4-37ae-44d5-9279-7327e46a8d4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:82:60', 'vm-uuid': 'b25da8d6-1222-4856-bda1-e0e51c69f26d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: INFO os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:82:60,bridge_name='br-int',has_traffic_filtering=True,id=00b3a3d4-37ae-44d5-9279-7327e46a8d4f,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3a3d4-37')
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9e:6e,bridge_name='br-int',has_traffic_filtering=True,id=78781ae1-af5d-477b-a44c-85d53d08c755,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78781ae1-af') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9e:6e,bridge_name='br-int',has_traffic_filtering=True,id=78781ae1-af5d-477b-a44c-85d53d08c755,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78781ae1-af') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78781ae1-af, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78781ae1-af, col_values=(('external_ids', {'iface-id': '78781ae1-af5d-477b-a44c-85d53d08c755', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:9e:6e', 'vm-uuid': 'b25da8d6-1222-4856-bda1-e0e51c69f26d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:02 user nova-compute[72426]: INFO os_vif [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9e:6e,bridge_name='br-int',has_traffic_filtering=True,id=78781ae1-af5d-477b-a44c-85d53d08c755,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78781ae1-af')
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] No BDM found with device name hda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] No VIF found with MAC fa:16:3e:ef:36:7c, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] No VIF found with MAC fa:16:3e:0d:d8:ef, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:14:02 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Using config drive
Aug 01 08:14:02 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Creating config drive at /opt/stack/data/nova/instances/b25da8d6-1222-4856-bda1-e0e51c69f26d/disk.config
Aug 01 08:14:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b25da8d6-1222-4856-bda1-e0e51c69f26d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz13j_e1d {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b25da8d6-1222-4856-bda1-e0e51c69f26d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz13j_e1d" returned: 0 in 0.054s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-2a39eab5-0220-48df-adeb-f858d2aca189 req-34ec5c1e-6746-4e9f-8c54-153b4a55b466 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2a39eab5-0220-48df-adeb-f858d2aca189 req-34ec5c1e-6746-4e9f-8c54-153b4a55b466 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2a39eab5-0220-48df-adeb-f858d2aca189 req-34ec5c1e-6746-4e9f-8c54-153b4a55b466 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2a39eab5-0220-48df-adeb-f858d2aca189 req-34ec5c1e-6746-4e9f-8c54-153b4a55b466 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-2a39eab5-0220-48df-adeb-f858d2aca189 req-34ec5c1e-6746-4e9f-8c54-153b4a55b466 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:04 user nova-compute[72426]: WARNING nova.compute.manager [req-2a39eab5-0220-48df-adeb-f858d2aca189 req-34ec5c1e-6746-4e9f-8c54-153b4a55b466 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-712015d5-a173-4168-a49a-3dba6325ee29 for instance with vm_state building and task_state spawning.
Aug 01 08:14:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-bae3de38-4dfa-4aa9-b649-f75c41d5636f req-28fe399f-ee0f-4e43-b4f3-cc77636c5734 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bae3de38-4dfa-4aa9-b649-f75c41d5636f req-28fe399f-ee0f-4e43-b4f3-cc77636c5734 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bae3de38-4dfa-4aa9-b649-f75c41d5636f req-28fe399f-ee0f-4e43-b4f3-cc77636c5734 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bae3de38-4dfa-4aa9-b649-f75c41d5636f req-28fe399f-ee0f-4e43-b4f3-cc77636c5734 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-bae3de38-4dfa-4aa9-b649-f75c41d5636f req-28fe399f-ee0f-4e43-b4f3-cc77636c5734 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:05 user nova-compute[72426]: WARNING nova.compute.manager [req-bae3de38-4dfa-4aa9-b649-f75c41d5636f req-28fe399f-ee0f-4e43-b4f3-cc77636c5734 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-c68cd240-bcb2-4864-96ed-697b41cfc678 for instance with vm_state building and task_state spawning.
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:06 user nova-compute[72426]: WARNING nova.compute.manager [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-712015d5-a173-4168-a49a-3dba6325ee29 for instance with vm_state building and task_state spawning.
Aug 01 08:14:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:06 user nova-compute[72426]: WARNING nova.compute.manager [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 for instance with vm_state building and task_state spawning.
Aug 01 08:14:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:06 user nova-compute[72426]: WARNING nova.compute.manager [req-62112cdd-d56e-421d-b3df-ee0e10df8251 req-3b0153e4-787e-43a4-81cd-9028736e7acc service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 for instance with vm_state building and task_state spawning.
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-835c0aa9-2e67-4259-b94e-270a8295f94e req-12e8ec6a-f15e-490a-8d5d-20a91b6f43d1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-835c0aa9-2e67-4259-b94e-270a8295f94e req-12e8ec6a-f15e-490a-8d5d-20a91b6f43d1 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-835c0aa9-2e67-4259-b94e-270a8295f94e req-12e8ec6a-f15e-490a-8d5d-20a91b6f43d1 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-835c0aa9-2e67-4259-b94e-270a8295f94e req-12e8ec6a-f15e-490a-8d5d-20a91b6f43d1 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-835c0aa9-2e67-4259-b94e-270a8295f94e req-12e8ec6a-f15e-490a-8d5d-20a91b6f43d1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:07 user nova-compute[72426]: WARNING nova.compute.manager [req-835c0aa9-2e67-4259-b94e-270a8295f94e req-12e8ec6a-f15e-490a-8d5d-20a91b6f43d1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-78781ae1-af5d-477b-a44c-85d53d08c755 for instance with vm_state building and task_state spawning.
Aug 01 08:14:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:07 user nova-compute[72426]: WARNING nova.compute.manager [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-c68cd240-bcb2-4864-96ed-697b41cfc678 for instance with vm_state building and task_state spawning.
Aug 01 08:14:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:07 user nova-compute[72426]: WARNING nova.compute.manager [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 for instance with vm_state building and task_state spawning.
Aug 01 08:14:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:07 user nova-compute[72426]: WARNING nova.compute.manager [req-e926f368-2f37-4083-8a20-521e8e6ce115 req-bc817df4-94d2-4c29-8460-530cca2377f1 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 for instance with vm_state building and task_state spawning.
Aug 01 08:14:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:08 user nova-compute[72426]: INFO nova.compute.manager [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Terminating instance
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:08 user nova-compute[72426]: WARNING nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-945a82f8-68fd-49bb-90de-95156e45e7d2 for instance with vm_state building and task_state spawning.
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:08 user nova-compute[72426]: WARNING nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-945a82f8-68fd-49bb-90de-95156e45e7d2 for instance with vm_state building and task_state spawning.
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:08 user nova-compute[72426]: WARNING nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f for instance with vm_state building and task_state spawning.
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:08 user nova-compute[72426]: WARNING nova.compute.manager [req-525361e4-4b23-46ff-a534-6715931501ca req-e3686290-2f10-4ce7-bf5a-d3a26b50d7e5 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f for instance with vm_state building and task_state spawning.
Aug 01 08:14:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:08 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Instance destroyed successfully.
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.objects.instance [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lazy-loading 'resources' on Instance uuid 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2077957354',display_name='tempest-VolumesActionsTest-instance-2077957354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2077957354',id=14,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc2a913710a44a50927c9e68e9807367',ramdisk_id='',reservation_id='r-b39q8shi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-55827117',owner_user_name='tempest-VolumesActionsTest-55827117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:12:27Z,user_data=None,user_id='2845bfd89e8e4057ac9464f5bf3b52be',uuid=00bfb96d-49b7-47f7-8cb9-0e4730f5ee80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "address": "fa:16:3e:99:58:26", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ffdfd7-0c", "ovs_interfaceid": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converting VIF {"id": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "address": "fa:16:3e:99:58:26", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ffdfd7-0c", "ovs_interfaceid": "66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:26,bridge_name='br-int',has_traffic_filtering=True,id=66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ffdfd7-0c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:08 user nova-compute[72426]: DEBUG os_vif [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:26,bridge_name='br-int',has_traffic_filtering=True,id=66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ffdfd7-0c') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66ffdfd7-0c, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:09 user nova-compute[72426]: INFO os_vif [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:26,bridge_name='br-int',has_traffic_filtering=True,id=66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ffdfd7-0c')
Aug 01 08:14:09 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Deleting instance files /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80_del
Aug 01 08:14:09 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Deletion of /opt/stack/data/nova/instances/00bfb96d-49b7-47f7-8cb9-0e4730f5ee80_del complete
Aug 01 08:14:09 user nova-compute[72426]: INFO nova.compute.manager [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 01 08:14:09 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-d357803f-6ee4-41c0-99c5-b2badea9a0c1 req-ea323f1c-3935-406c-ac5b-f0af18f289ba service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d357803f-6ee4-41c0-99c5-b2badea9a0c1 req-ea323f1c-3935-406c-ac5b-f0af18f289ba service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d357803f-6ee4-41c0-99c5-b2badea9a0c1 req-ea323f1c-3935-406c-ac5b-f0af18f289ba service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d357803f-6ee4-41c0-99c5-b2badea9a0c1 req-ea323f1c-3935-406c-ac5b-f0af18f289ba service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-d357803f-6ee4-41c0-99c5-b2badea9a0c1 req-ea323f1c-3935-406c-ac5b-f0af18f289ba service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:09 user nova-compute[72426]: WARNING nova.compute.manager [req-d357803f-6ee4-41c0-99c5-b2badea9a0c1 req-ea323f1c-3935-406c-ac5b-f0af18f289ba service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-78781ae1-af5d-477b-a44c-85d53d08c755 for instance with vm_state building and task_state spawning.
Aug 01 08:14:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Received event network-vif-unplugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] Acquiring lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] No waiting events found dispatching network-vif-unplugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Received event network-vif-unplugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Received event network-vif-plugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] Acquiring lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] No waiting events found dispatching network-vif-plugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:09 user nova-compute[72426]: WARNING nova.compute.manager [req-f061e086-9b5c-4520-af18-6a34497a1439 req-8a7bf395-205b-417a-a238-63b1595155e6 service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Received unexpected event network-vif-plugged-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee for instance with vm_state active and task_state deleting.
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877649.7165852, b25da8d6-1222-4856-bda1-e0e51c69f26d => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:14:09 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] VM Resumed (Lifecycle Event)
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:14:09 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance spawned successfully.
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:14:09 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877649.7216856, b25da8d6-1222-4856-bda1-e0e51c69f26d => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:14:09 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] VM Started (Lifecycle Event)
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:14:09 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:14:09 user nova-compute[72426]: INFO nova.compute.manager [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Took 12.56 seconds to spawn the instance on the hypervisor.
Aug 01 08:14:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:14:09 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Took 0.78 seconds to deallocate network for instance.
Aug 01 08:14:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:10 user nova-compute[72426]: INFO nova.compute.manager [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Took 51.71 seconds to build instance.
Aug 01 08:14:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bd7fae96-4cc0-483e-ac75-54806761d489 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.850s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:10 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:14:10 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:14:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:10 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Deleted allocations for instance 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80
Aug 01 08:14:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d31ca84e-55ce-4e38-9599-850f3c982d52 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "00bfb96d-49b7-47f7-8cb9-0e4730f5ee80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.728s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-b11fea61-52f8-48c0-ac84-b9969719cae9 req-00257fde-8d28-4358-afbf-caf73ce6d78c service nova] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Received event network-vif-deleted-66ffdfd7-0c18-436f-a1e6-ffbea15fa6ee {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:14 user nova-compute[72426]: INFO nova.compute.manager [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Terminating instance
Aug 01 08:14:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-8927de55-b13c-45b1-a7da-3a23e9a9bcf8 req-214f6c6e-fd20-4ce4-962b-5f83ddda5f15 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Received event network-vif-unplugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8927de55-b13c-45b1-a7da-3a23e9a9bcf8 req-214f6c6e-fd20-4ce4-962b-5f83ddda5f15 service nova] Acquiring lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8927de55-b13c-45b1-a7da-3a23e9a9bcf8 req-214f6c6e-fd20-4ce4-962b-5f83ddda5f15 service nova] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8927de55-b13c-45b1-a7da-3a23e9a9bcf8 req-214f6c6e-fd20-4ce4-962b-5f83ddda5f15 service nova] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-8927de55-b13c-45b1-a7da-3a23e9a9bcf8 req-214f6c6e-fd20-4ce4-962b-5f83ddda5f15 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] No waiting events found dispatching network-vif-unplugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-8927de55-b13c-45b1-a7da-3a23e9a9bcf8 req-214f6c6e-fd20-4ce4-962b-5f83ddda5f15 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Received event network-vif-unplugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Instance destroyed successfully.
Aug 01 08:14:14 user nova-compute[72426]: DEBUG nova.objects.instance [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lazy-loading 'resources' on Instance uuid cbe30b5e-a2e4-4f0c-a3af-44125149bfb6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-241111062',display_name='tempest-VolumesAdminNegativeTest-server-241111062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-241111062',id=13,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebec9a843238456ca5d7fdf893326c4f',ramdisk_id='',reservation_id='r-k65oveis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-336374183',owner_user_name='tempest-VolumesAdminNegativeTest-336374183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:12:22Z,user_data=None,user_id='b37a9ddbd9454c0996c1271a13c941d4',uuid=cbe30b5e-a2e4-4f0c-a3af-44125149bfb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "address": "fa:16:3e:55:e1:7d", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2311eb0-c9", "ovs_interfaceid": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converting VIF {"id": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "address": "fa:16:3e:55:e1:7d", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2311eb0-c9", "ovs_interfaceid": "d2311eb0-c943-4c4d-8358-30c8b16ade86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e1:7d,bridge_name='br-int',has_traffic_filtering=True,id=d2311eb0-c943-4c4d-8358-30c8b16ade86,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2311eb0-c9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG os_vif [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e1:7d,bridge_name='br-int',has_traffic_filtering=True,id=d2311eb0-c943-4c4d-8358-30c8b16ade86,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2311eb0-c9') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2311eb0-c9, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:14:14 user nova-compute[72426]: INFO os_vif [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e1:7d,bridge_name='br-int',has_traffic_filtering=True,id=d2311eb0-c943-4c4d-8358-30c8b16ade86,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2311eb0-c9')
Aug 01 08:14:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Deleting instance files /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6_del
Aug 01 08:14:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Deletion of /opt/stack/data/nova/instances/cbe30b5e-a2e4-4f0c-a3af-44125149bfb6_del complete
Aug 01 08:14:15 user nova-compute[72426]: INFO nova.compute.manager [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 01 08:14:15 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:14:15 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:14:15 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:14:15 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:14:15 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Took 0.59 seconds to deallocate network for instance.
Aug 01 08:14:15 user nova-compute[72426]: DEBUG nova.compute.manager [req-0b2d95e4-e475-4262-9eb1-8d8dcca11fbe req-2668dd31-e657-40d4-9f90-c8e700601224 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Received event network-vif-deleted-d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:15 user nova-compute[72426]: INFO nova.compute.manager [req-0b2d95e4-e475-4262-9eb1-8d8dcca11fbe req-2668dd31-e657-40d4-9f90-c8e700601224 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Neutron deleted interface d2311eb0-c943-4c4d-8358-30c8b16ade86; detaching it from the instance and deleting it from the info cache
Aug 01 08:14:15 user nova-compute[72426]: DEBUG nova.network.neutron [req-0b2d95e4-e475-4262-9eb1-8d8dcca11fbe req-2668dd31-e657-40d4-9f90-c8e700601224 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:14:15 user nova-compute[72426]: DEBUG nova.compute.manager [req-0b2d95e4-e475-4262-9eb1-8d8dcca11fbe req-2668dd31-e657-40d4-9f90-c8e700601224 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Detach interface failed, port_id=d2311eb0-c943-4c4d-8358-30c8b16ade86, reason: Instance cbe30b5e-a2e4-4f0c-a3af-44125149bfb6 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:14:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:16 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:14:16 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:14:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:16 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Deleted allocations for instance cbe30b5e-a2e4-4f0c-a3af-44125149bfb6
Aug 01 08:14:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b4f5f78e-4586-43e1-99d9-ed34de988e6e tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-62b89c0c-1551-4e67-9246-5084236b545a req-0d1c2926-83aa-48e0-8014-c3470183b1e1 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Received event network-vif-plugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62b89c0c-1551-4e67-9246-5084236b545a req-0d1c2926-83aa-48e0-8014-c3470183b1e1 service nova] Acquiring lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62b89c0c-1551-4e67-9246-5084236b545a req-0d1c2926-83aa-48e0-8014-c3470183b1e1 service nova] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-62b89c0c-1551-4e67-9246-5084236b545a req-0d1c2926-83aa-48e0-8014-c3470183b1e1 service nova] Lock "cbe30b5e-a2e4-4f0c-a3af-44125149bfb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-62b89c0c-1551-4e67-9246-5084236b545a req-0d1c2926-83aa-48e0-8014-c3470183b1e1 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] No waiting events found dispatching network-vif-plugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:16 user nova-compute[72426]: WARNING nova.compute.manager [req-62b89c0c-1551-4e67-9246-5084236b545a req-0d1c2926-83aa-48e0-8014-c3470183b1e1 service nova] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Received unexpected event network-vif-plugged-d2311eb0-c943-4c4d-8358-30c8b16ade86 for instance with vm_state deleted and task_state None.
Aug 01 08:14:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:17 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 08:14:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] There are 0 instances to clean {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 08:14:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:22 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72426) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:23 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877648.930334, 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:14:23 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] VM Stopped (Lifecycle Event)
Aug 01 08:14:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-b3e36ff6-0b75-4df1-9eea-e550b2f3757d None None] [instance: 00bfb96d-49b7-47f7-8cb9-0e4730f5ee80] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:14:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:27 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:14:27 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=6849MB free_disk=25.633899688720703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Applying migration context for instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 as it has an incoming, in-progress migration 490eac06-5751-4282-82c7-09b668751b0b. Migration status is finished {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 08:14:27 user nova-compute[72426]: INFO nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating resource usage from migration 490eac06-5751-4282-82c7-09b668751b0b
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 457df7dd-4e0f-4d72-915b-644f0c8588eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance f826ffe7-92dc-4f05-9298-1236513a1af2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Migration 490eac06-5751-4282-82c7-09b668751b0b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance b25da8d6-1222-4856-bda1-e0e51c69f26d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 3b0a5550-8c33-4d45-846f-45cfe9fffe67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2236c44a-562a-4b67-a487-ad51180dbaa0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.781s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:27 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:14:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:14:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:14:28 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:14:29 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Updating instance_info_cache with network_info: [{"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:14:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-f826ffe7-92dc-4f05-9298-1236513a1af2" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:14:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:14:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:29 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877654.904208, cbe30b5e-a2e4-4f0c-a3af-44125149bfb6 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:14:29 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] VM Stopped (Lifecycle Event)
Aug 01 08:14:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9e8ecf6a-5775-4726-aada-f75525018265 None None] [instance: cbe30b5e-a2e4-4f0c-a3af-44125149bfb6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:14:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:30 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:30 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:31 user nova-compute[72426]: INFO nova.compute.manager [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Detaching volume fc631164-acbf-4ad5-a948-f02ccf95e320
Aug 01 08:14:31 user nova-compute[72426]: INFO nova.virt.block_device [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Attempting to driver detach volume fc631164-acbf-4ad5-a948-f02ccf95e320 from mountpoint /dev/vdb
Aug 01 08:14:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Attempting to detach device vdb from instance f826ffe7-92dc-4f05-9298-1236513a1af2 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:14:31 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:14:31 user nova-compute[72426]:   <source dev="/dev/sdg"/>
Aug 01 08:14:31 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:14:31 user nova-compute[72426]:   <serial>fc631164-acbf-4ad5-a948-f02ccf95e320</serial>
Aug 01 08:14:31 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:14:31 user nova-compute[72426]: </disk>
Aug 01 08:14:31 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:14:31 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Successfully detached device vdb from instance f826ffe7-92dc-4f05-9298-1236513a1af2 from the persistent domain config.
Aug 01 08:14:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f826ffe7-92dc-4f05-9298-1236513a1af2 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:14:31 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:14:31 user nova-compute[72426]:   <source dev="/dev/sdg"/>
Aug 01 08:14:31 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:14:31 user nova-compute[72426]:   <serial>fc631164-acbf-4ad5-a948-f02ccf95e320</serial>
Aug 01 08:14:31 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:14:31 user nova-compute[72426]: </disk>
Aug 01 08:14:31 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690877671.8700254, f826ffe7-92dc-4f05-9298-1236513a1af2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f826ffe7-92dc-4f05-9298-1236513a1af2 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:14:31 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Successfully detached device vdb from instance f826ffe7-92dc-4f05-9298-1236513a1af2 from the live domain config.
Aug 01 08:14:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZsyNneg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:14:31 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:14:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f85ae01-7670-4b09-be8f-8cb2e3648a62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8af43eb-3668-4da9-bb7a-eb8200490858]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:14:31 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:14:31 user nova-compute[72426]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 (non-flash)
Aug 01 08:14:31 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38fbee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320'): ({'sdg'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Removing single pathed devices sdg {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[df446755-43b5-4740-bc0e-b448f2a135f3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b43137-052a-4105-849b-df146a43ef3d]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Flushing IO for device /dev/sdg {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:14:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a28b845-4901-4c5b-9cbb-a6d4cd67047b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61a79f6-2c6d-4724-b42e-73cebe780a62]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] SCSI volumes sdg have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f740f8a3-95d5-4c6e-9c7f-a96af3a63738]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9191faa8-91d5-4372-9a7c-432adee075b6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320, portal: 172.16.0.220,3260]
Aug 01 08:14:32 user nova-compute[72426]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320, portal: 172.16.0.220,3260] successful.
Aug 01 08:14:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc631164-acbf-4ad5-a948-f02ccf95e320 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f3ff50-fb2d-4e69-9aa9-338308311a91]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] <== disconnect_volume: return (282ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lazy-loading 'flavor' on Instance uuid f826ffe7-92dc-4f05-9298-1236513a1af2 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:14:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f4b502f4-dd4a-4683-aaae-7f17053ec25f tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.713s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Port 197ec10c-39a4-4c89-b675-b7bb2ee90b1f binding to destination host user is already ACTIVE {{(pid=72426) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 08:14:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:14:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquired lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:14:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:14:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG nova.network.neutron [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance_info_cache with network_info: [{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Releasing lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Creating tmpfile /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/tmp44o6j41m to verify with other compute node that the instance is on the same shared storage. {{(pid=72426) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG nova.compute.manager [req-d7472fa9-ab0e-467d-86c3-acf2e4ce4740 req-4fdb439c-40ec-44d0-ac2e-ae1669e935f6 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-unplugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d7472fa9-ab0e-467d-86c3-acf2e4ce4740 req-4fdb439c-40ec-44d0-ac2e-ae1669e935f6 service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d7472fa9-ab0e-467d-86c3-acf2e4ce4740 req-4fdb439c-40ec-44d0-ac2e-ae1669e935f6 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d7472fa9-ab0e-467d-86c3-acf2e4ce4740 req-4fdb439c-40ec-44d0-ac2e-ae1669e935f6 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG nova.compute.manager [req-d7472fa9-ab0e-467d-86c3-acf2e4ce4740 req-4fdb439c-40ec-44d0-ac2e-ae1669e935f6 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-unplugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:37 user nova-compute[72426]: WARNING nova.compute.manager [req-d7472fa9-ab0e-467d-86c3-acf2e4ce4740 req-4fdb439c-40ec-44d0-ac2e-ae1669e935f6 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-unplugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state resized and task_state resize_reverting.
Aug 01 08:14:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance destroyed successfully.
Aug 01 08:14:37 user nova-compute[72426]: DEBUG nova.objects.instance [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'resources' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-422374365',display_name='tempest-ServerActionsTestOtherB-server-422374365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-422374365',id=4,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl2oApS4LEi4Ig2bO8yUSo9wl16TwUkqqncZenLkty2XY524bkKbL5wZtWU4/2TUExag9ZWoRoLkyDVuWFoEcjk8zjc/94JyqcQHN/o4NaNjQ0nXMRCRju0bzFZ7w6HLQ==',key_name='tempest-keypair-1006503589',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d0ba9feb9244e88cb3945f553c8ac7',ramdisk_id='',reservation_id='r-zqp59lbx',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-252722777',owner_user_name='tempest-ServerActionsTestOtherB-252722777-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fec3b4665a148e498a731cfeef7f589',uuid=dad9feb1-d5fa-4ed2-9fe3-1573010446f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converting VIF {"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG os_vif [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap197ec10c-39, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:37 user nova-compute[72426]: INFO os_vif [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39')
Aug 01 08:14:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:14:37 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:14:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a00dfbb-c7ea-48f6-8240-46402f1bbf71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a783dcf-fae6-439d-bea6-6714332ee16a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:14:37 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:37 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:14:37 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38fe25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'): ({'sdd'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Removing single pathed devices sdd {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2669c4-0a5e-44d8-8a02-69fd52211268]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[251178dc-cdc7-4eec-84ab-940fe8cfff7d]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Flushing IO for device /dev/sdd {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faae632-714b-4686-9243-7ce92f245e5c]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56b6e45-9b9c-4dcc-9fb1-2ed4eebd2b83]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4229fb1-e039-4e6a-95f0-ee83e669abb6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f25a95b-ded7-4e43-a154-aea426032142]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]
Aug 01 08:14:38 user nova-compute[72426]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.
Aug 01 08:14:38 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d65892-c3ee-4b59-bbd1-bc559ca9cdd5]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] <== disconnect_volume: return (337ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:14:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG nova.objects.instance [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'migration_context' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG nova.compute.manager [req-a5af2298-0ee5-48cc-86bd-a6d1c9de79c5 req-f3c833f3-3278-44a4-92cb-28ed7af29817 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a5af2298-0ee5-48cc-86bd-a6d1c9de79c5 req-f3c833f3-3278-44a4-92cb-28ed7af29817 service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a5af2298-0ee5-48cc-86bd-a6d1c9de79c5 req-f3c833f3-3278-44a4-92cb-28ed7af29817 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a5af2298-0ee5-48cc-86bd-a6d1c9de79c5 req-f3c833f3-3278-44a4-92cb-28ed7af29817 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG nova.compute.manager [req-a5af2298-0ee5-48cc-86bd-a6d1c9de79c5 req-f3c833f3-3278-44a4-92cb-28ed7af29817 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:39 user nova-compute[72426]: WARNING nova.compute.manager [req-a5af2298-0ee5-48cc-86bd-a6d1c9de79c5 req-f3c833f3-3278-44a4-92cb-28ed7af29817 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state resized and task_state resize_reverting.
Aug 01 08:14:39 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.451s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:39 user nova-compute[72426]: INFO nova.compute.manager [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Swapping old allocation on dict_keys(['857b4ca4-2f0e-4cc5-bf9a-50b98073ab99']) held by migration 490eac06-5751-4282-82c7-09b668751b0b for instance
Aug 01 08:14:39 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Overwriting current allocation {'allocations': {'857b4ca4-2f0e-4cc5-bf9a-50b98073ab99': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': '32d0ba9feb9244e88cb3945f553c8ac7', 'user_id': '4fec3b4665a148e498a731cfeef7f589', 'consumer_generation': 1} on consumer dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquired lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:14:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance_info_cache with network_info: [{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Releasing lock "refresh_cache-dad9feb1-d5fa-4ed2-9fe3-1573010446f6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG os_brick.utils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd365ba-933a-4b01-8e90-9fc8c7460abf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50f70b6-4364-4d23-b8c8-886f67459a74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4533f916-5216-441a-b8df-150b53a2ccee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c072f75-4173-4cb7-b7d1-d76073de1cc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:14:40 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:14:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e410af0e-9bf3-4309-a854-7664b72655bc]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:14:40 user nova-compute[72426]: DEBUG os_brick.utils [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:14:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Starting finish_revert_migration {{(pid=72426) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Start _get_guest_xml network_info=[{"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dad9feb1-d5fa-4ed2-9fe3-1573010446f6', 'attached_at': '2023-08-01T08:14:48.000000', 'detached_at': '', 'volume_id': '46683ff1-19fb-4c9c-8af3-48f1e1fcc57e', 'serial': '46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'abac6040-6f56-4382-8c53-e8e0b2111274', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:14:48 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:14:48 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.objects.instance [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'vcpu_model' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:14:48 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:14:48 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:14:48 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe21cbe-3795-47bc-ba9e-f8457787eed8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:14:48 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea8fdc0-2373-4d05-bd94-d68bbb0f6190]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e] added
Aug 01 08:14:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[89195f70-9197-4f3f-86d1-f8307cf4ba74]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306545d-e52f-4f00-8c20-2e3bc5e56689]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBuUPAKz {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBuUPAKz" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc4ee0b-4193-4fa4-9d03-f6bbe2a96dcd]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZBuUPAKz'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[134c3ebe-ad3d-48fb-8a6c-c2c17e7145aa]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a703cd-881a-48c4-99ff-4daaa2c7536f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:14:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:14:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a14eb59-11ca-44f8-ad99-cfafd5823533]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]
Aug 01 08:14:48 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.
Aug 01 08:14:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f48c319-a646-47df-8ad6-43ab441f8a87]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffbf3d6-cee3-4e76-b4c7-69f34edd8b71]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:14:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:14:48 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:14:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12e8063-bbf7-45fb-ae6d-2911da161b73]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:14:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23362316166383539', 'path': '/dev/sdd'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362316166383539', 'path': '/dev/sdd'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-422374365',display_name='tempest-ServerActionsTestOtherB-server-422374365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-422374365',id=4,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl2oApS4LEi4Ig2bO8yUSo9wl16TwUkqqncZenLkty2XY524bkKbL5wZtWU4/2TUExag9ZWoRoLkyDVuWFoEcjk8zjc/94JyqcQHN/o4NaNjQ0nXMRCRju0bzFZ7w6HLQ==',key_name='tempest-keypair-1006503589',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32d0ba9feb9244e88cb3945f553c8ac7',ramdisk_id='',reservation_id='r-zqp59lbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-252722777',owner_user_name='tempest-ServerActionsTestOtherB-252722777-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fec3b4665a148e498a731cfeef7f589',uuid=dad9feb1-d5fa-4ed2-9fe3-1573010446f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converting VIF {"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:14:49 user nova-compute[72426]:   <uuid>dad9feb1-d5fa-4ed2-9fe3-1573010446f6</uuid>
Aug 01 08:14:49 user nova-compute[72426]:   <name>instance-00000004</name>
Aug 01 08:14:49 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:14:49 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:14:49 user nova-compute[72426]:   <metadata>
Aug 01 08:14:49 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:14:49 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:14:49 user nova-compute[72426]:       <nova:name>tempest-ServerActionsTestOtherB-server-422374365</nova:name>
Aug 01 08:14:49 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:14:48</nova:creationTime>
Aug 01 08:14:49 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:14:49 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:14:49 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:14:49 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:14:49 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:14:49 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:14:49 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:14:49 user nova-compute[72426]:       <nova:owner>
Aug 01 08:14:49 user nova-compute[72426]:         <nova:user uuid="4fec3b4665a148e498a731cfeef7f589">tempest-ServerActionsTestOtherB-252722777-project-member</nova:user>
Aug 01 08:14:49 user nova-compute[72426]:         <nova:project uuid="32d0ba9feb9244e88cb3945f553c8ac7">tempest-ServerActionsTestOtherB-252722777</nova:project>
Aug 01 08:14:49 user nova-compute[72426]:       </nova:owner>
Aug 01 08:14:49 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:14:49 user nova-compute[72426]:       <nova:ports>
Aug 01 08:14:49 user nova-compute[72426]:         <nova:port uuid="197ec10c-39a4-4c89-b675-b7bb2ee90b1f">
Aug 01 08:14:49 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 08:14:49 user nova-compute[72426]:         </nova:port>
Aug 01 08:14:49 user nova-compute[72426]:       </nova:ports>
Aug 01 08:14:49 user nova-compute[72426]:     </nova:instance>
Aug 01 08:14:49 user nova-compute[72426]:   </metadata>
Aug 01 08:14:49 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:14:49 user nova-compute[72426]:     <system>
Aug 01 08:14:49 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:14:49 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:14:49 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:14:49 user nova-compute[72426]:       <entry name="serial">dad9feb1-d5fa-4ed2-9fe3-1573010446f6</entry>
Aug 01 08:14:49 user nova-compute[72426]:       <entry name="uuid">dad9feb1-d5fa-4ed2-9fe3-1573010446f6</entry>
Aug 01 08:14:49 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:14:49 user nova-compute[72426]:     </system>
Aug 01 08:14:49 user nova-compute[72426]:   </sysinfo>
Aug 01 08:14:49 user nova-compute[72426]:   <os>
Aug 01 08:14:49 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:14:49 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:14:49 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:14:49 user nova-compute[72426]:   </os>
Aug 01 08:14:49 user nova-compute[72426]:   <features>
Aug 01 08:14:49 user nova-compute[72426]:     <acpi/>
Aug 01 08:14:49 user nova-compute[72426]:     <apic/>
Aug 01 08:14:49 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:14:49 user nova-compute[72426]:   </features>
Aug 01 08:14:49 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:14:49 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:14:49 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:14:49 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:14:49 user nova-compute[72426]:   </clock>
Aug 01 08:14:49 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:14:49 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:14:49 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:14:49 user nova-compute[72426]:   </cpu>
Aug 01 08:14:49 user nova-compute[72426]:   <devices>
Aug 01 08:14:49 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:14:49 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:14:49 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk"/>
Aug 01 08:14:49 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:14:49 user nova-compute[72426]:     </disk>
Aug 01 08:14:49 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:14:49 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:14:49 user nova-compute[72426]:       <source dev="/dev/sdd"/>
Aug 01 08:14:49 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:14:49 user nova-compute[72426]:       <serial>46683ff1-19fb-4c9c-8af3-48f1e1fcc57e</serial>
Aug 01 08:14:49 user nova-compute[72426]:     </disk>
Aug 01 08:14:49 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:14:49 user nova-compute[72426]:       <mac address="fa:16:3e:84:24:c8"/>
Aug 01 08:14:49 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:14:49 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:14:49 user nova-compute[72426]:       <target dev="tap197ec10c-39"/>
Aug 01 08:14:49 user nova-compute[72426]:     </interface>
Aug 01 08:14:49 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:14:49 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/console.log" append="off"/>
Aug 01 08:14:49 user nova-compute[72426]:     </serial>
Aug 01 08:14:49 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:14:49 user nova-compute[72426]:     <video>
Aug 01 08:14:49 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:14:49 user nova-compute[72426]:     </video>
Aug 01 08:14:49 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:14:49 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:14:49 user nova-compute[72426]:     </rng>
Aug 01 08:14:49 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:14:49 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:14:49 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:14:49 user nova-compute[72426]:     </memballoon>
Aug 01 08:14:49 user nova-compute[72426]:   </devices>
Aug 01 08:14:49 user nova-compute[72426]: </domain>
Aug 01 08:14:49 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-422374365',display_name='tempest-ServerActionsTestOtherB-server-422374365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-422374365',id=4,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl2oApS4LEi4Ig2bO8yUSo9wl16TwUkqqncZenLkty2XY524bkKbL5wZtWU4/2TUExag9ZWoRoLkyDVuWFoEcjk8zjc/94JyqcQHN/o4NaNjQ0nXMRCRju0bzFZ7w6HLQ==',key_name='tempest-keypair-1006503589',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32d0ba9feb9244e88cb3945f553c8ac7',ramdisk_id='',reservation_id='r-zqp59lbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-252722777',owner_user_name='tempest-ServerActionsTestOtherB-252722777-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:14:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fec3b4665a148e498a731cfeef7f589',uuid=dad9feb1-d5fa-4ed2-9fe3-1573010446f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converting VIF {"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG os_vif [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap197ec10c-39, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap197ec10c-39, col_values=(('external_ids', {'iface-id': '197ec10c-39a4-4c89-b675-b7bb2ee90b1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:24:c8', 'vm-uuid': 'dad9feb1-d5fa-4ed2-9fe3-1573010446f6'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:14:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:49 user nova-compute[72426]: INFO os_vif [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39')
Aug 01 08:14:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-60923c25-c0cb-4a01-9a02-28f118c36193 req-2be5345f-26e5-42c9-93ce-3732557f89c1 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-60923c25-c0cb-4a01-9a02-28f118c36193 req-2be5345f-26e5-42c9-93ce-3732557f89c1 service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-60923c25-c0cb-4a01-9a02-28f118c36193 req-2be5345f-26e5-42c9-93ce-3732557f89c1 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-60923c25-c0cb-4a01-9a02-28f118c36193 req-2be5345f-26e5-42c9-93ce-3732557f89c1 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-60923c25-c0cb-4a01-9a02-28f118c36193 req-2be5345f-26e5-42c9-93ce-3732557f89c1 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:51 user nova-compute[72426]: WARNING nova.compute.manager [req-60923c25-c0cb-4a01-9a02-28f118c36193 req-2be5345f-26e5-42c9-93ce-3732557f89c1 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state resized and task_state resize_reverting.
Aug 01 08:14:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:52 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877677.8407402, dad9feb1-d5fa-4ed2-9fe3-1573010446f6 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:14:52 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] VM Stopped (Lifecycle Event)
Aug 01 08:14:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-97f5f610-dee7-4928-9944-36a54e42651f None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:14:53 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877693.4495726, dad9feb1-d5fa-4ed2-9fe3-1573010446f6 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:14:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] VM Resumed (Lifecycle Event)
Aug 01 08:14:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:14:53 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance running successfully.
Aug 01 08:14:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] finish_revert_migration finished successfully. {{(pid=72426) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 01 08:14:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:14:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:14:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 08:14:53 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877693.4569173, dad9feb1-d5fa-4ed2-9fe3-1573010446f6 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:14:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] VM Started (Lifecycle Event)
Aug 01 08:14:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:14:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-e0473e27-044e-43ac-92ee-9e61a07fe3ed req-93e947af-8be7-4eae-a6ba-5daf9570e97b service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:14:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e0473e27-044e-43ac-92ee-9e61a07fe3ed req-93e947af-8be7-4eae-a6ba-5daf9570e97b service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:14:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e0473e27-044e-43ac-92ee-9e61a07fe3ed req-93e947af-8be7-4eae-a6ba-5daf9570e97b service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:14:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e0473e27-044e-43ac-92ee-9e61a07fe3ed req-93e947af-8be7-4eae-a6ba-5daf9570e97b service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:14:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-e0473e27-044e-43ac-92ee-9e61a07fe3ed req-93e947af-8be7-4eae-a6ba-5daf9570e97b service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:14:53 user nova-compute[72426]: WARNING nova.compute.manager [req-e0473e27-044e-43ac-92ee-9e61a07fe3ed req-93e947af-8be7-4eae-a6ba-5daf9570e97b service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state resized and task_state resize_reverting.
Aug 01 08:14:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:14:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 08:14:53 user nova-compute[72426]: INFO nova.compute.manager [None req-48a0b05c-a215-4dbb-bc63-04495baff4cc tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance to original state: 'active'
Aug 01 08:14:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:14:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "0debd99f-9724-42ed-8048-857edce10e6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "0debd99f-9724-42ed-8048-857edce10e6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:15:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:00 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:15:00 user nova-compute[72426]: INFO nova.compute.claims [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Claim successful on node user
Aug 01 08:15:00 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Refreshing inventories for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 08:15:00 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Updating ProviderTree inventory for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 08:15:00 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Updating inventory in ProviderTree for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 08:15:00 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Refreshing aggregate associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, aggregates: None {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 08:15:00 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Refreshing trait associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, traits: COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.675s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:15:01 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:15:01 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG nova.policy [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2845bfd89e8e4057ac9464f5bf3b52be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc2a913710a44a50927c9e68e9807367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:15:01 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Creating image(s)
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "/opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "/opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "/opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.174s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk 1073741824" returned: 0 in 0.051s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Cannot resize image /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG nova.objects.instance [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lazy-loading 'migration_context' on Instance uuid 0debd99f-9724-42ed-8048-857edce10e6f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Successfully created port: 60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Ensure instance console log exists: /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Successfully updated port: 60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "refresh_cache-0debd99f-9724-42ed-8048-857edce10e6f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquired lock "refresh_cache-0debd99f-9724-42ed-8048-857edce10e6f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-1e0288f6-17a9-4c95-bbf5-33c3f0e212d6 req-c7a587cd-6a5d-4a23-867d-5a620000fdfa service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Received event network-changed-60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-1e0288f6-17a9-4c95-bbf5-33c3f0e212d6 req-c7a587cd-6a5d-4a23-867d-5a620000fdfa service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Refreshing instance network info cache due to event network-changed-60c608b0-461b-46e4-b127-189bee33d399. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1e0288f6-17a9-4c95-bbf5-33c3f0e212d6 req-c7a587cd-6a5d-4a23-867d-5a620000fdfa service nova] Acquiring lock "refresh_cache-0debd99f-9724-42ed-8048-857edce10e6f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Updating instance_info_cache with network_info: [{"id": "60c608b0-461b-46e4-b127-189bee33d399", "address": "fa:16:3e:12:59:ce", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c608b0-46", "ovs_interfaceid": "60c608b0-461b-46e4-b127-189bee33d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Releasing lock "refresh_cache-0debd99f-9724-42ed-8048-857edce10e6f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Instance network_info: |[{"id": "60c608b0-461b-46e4-b127-189bee33d399", "address": "fa:16:3e:12:59:ce", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c608b0-46", "ovs_interfaceid": "60c608b0-461b-46e4-b127-189bee33d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1e0288f6-17a9-4c95-bbf5-33c3f0e212d6 req-c7a587cd-6a5d-4a23-867d-5a620000fdfa service nova] Acquired lock "refresh_cache-0debd99f-9724-42ed-8048-857edce10e6f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.network.neutron [req-1e0288f6-17a9-4c95-bbf5-33c3f0e212d6 req-c7a587cd-6a5d-4a23-867d-5a620000fdfa service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Refreshing network info cache for port 60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Start _get_guest_xml network_info=[{"id": "60c608b0-461b-46e4-b127-189bee33d399", "address": "fa:16:3e:12:59:ce", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c608b0-46", "ovs_interfaceid": "60c608b0-461b-46e4-b127-189bee33d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:15:03 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:15:03 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1912323582',display_name='tempest-VolumesActionsTest-instance-1912323582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1912323582',id=20,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc2a913710a44a50927c9e68e9807367',ramdisk_id='',reservation_id='r-cqe3ndse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-55827117',owner_user_name='tempest-VolumesActionsTest-55827117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:15:01Z,user_data=None,user_id='2845bfd89e8e4057ac9464f5bf3b52be',uuid=0debd99f-9724-42ed-8048-857edce10e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c608b0-461b-46e4-b127-189bee33d399", "address": "fa:16:3e:12:59:ce", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c608b0-46", "ovs_interfaceid": "60c608b0-461b-46e4-b127-189bee33d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converting VIF {"id": "60c608b0-461b-46e4-b127-189bee33d399", "address": "fa:16:3e:12:59:ce", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c608b0-46", "ovs_interfaceid": "60c608b0-461b-46e4-b127-189bee33d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:59:ce,bridge_name='br-int',has_traffic_filtering=True,id=60c608b0-461b-46e4-b127-189bee33d399,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c608b0-46') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.objects.instance [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lazy-loading 'pci_devices' on Instance uuid 0debd99f-9724-42ed-8048-857edce10e6f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:15:03 user nova-compute[72426]:   <uuid>0debd99f-9724-42ed-8048-857edce10e6f</uuid>
Aug 01 08:15:03 user nova-compute[72426]:   <name>instance-00000014</name>
Aug 01 08:15:03 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:15:03 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:15:03 user nova-compute[72426]:   <metadata>
Aug 01 08:15:03 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:15:03 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:15:03 user nova-compute[72426]:       <nova:name>tempest-VolumesActionsTest-instance-1912323582</nova:name>
Aug 01 08:15:03 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:15:03</nova:creationTime>
Aug 01 08:15:03 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:15:03 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:15:03 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:15:03 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:15:03 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:15:03 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:15:03 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:15:03 user nova-compute[72426]:       <nova:owner>
Aug 01 08:15:03 user nova-compute[72426]:         <nova:user uuid="2845bfd89e8e4057ac9464f5bf3b52be">tempest-VolumesActionsTest-55827117-project-member</nova:user>
Aug 01 08:15:03 user nova-compute[72426]:         <nova:project uuid="fc2a913710a44a50927c9e68e9807367">tempest-VolumesActionsTest-55827117</nova:project>
Aug 01 08:15:03 user nova-compute[72426]:       </nova:owner>
Aug 01 08:15:03 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:15:03 user nova-compute[72426]:       <nova:ports>
Aug 01 08:15:03 user nova-compute[72426]:         <nova:port uuid="60c608b0-461b-46e4-b127-189bee33d399">
Aug 01 08:15:03 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 08:15:03 user nova-compute[72426]:         </nova:port>
Aug 01 08:15:03 user nova-compute[72426]:       </nova:ports>
Aug 01 08:15:03 user nova-compute[72426]:     </nova:instance>
Aug 01 08:15:03 user nova-compute[72426]:   </metadata>
Aug 01 08:15:03 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:15:03 user nova-compute[72426]:     <system>
Aug 01 08:15:03 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:15:03 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:15:03 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:15:03 user nova-compute[72426]:       <entry name="serial">0debd99f-9724-42ed-8048-857edce10e6f</entry>
Aug 01 08:15:03 user nova-compute[72426]:       <entry name="uuid">0debd99f-9724-42ed-8048-857edce10e6f</entry>
Aug 01 08:15:03 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:15:03 user nova-compute[72426]:     </system>
Aug 01 08:15:03 user nova-compute[72426]:   </sysinfo>
Aug 01 08:15:03 user nova-compute[72426]:   <os>
Aug 01 08:15:03 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:15:03 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:15:03 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:15:03 user nova-compute[72426]:   </os>
Aug 01 08:15:03 user nova-compute[72426]:   <features>
Aug 01 08:15:03 user nova-compute[72426]:     <acpi/>
Aug 01 08:15:03 user nova-compute[72426]:     <apic/>
Aug 01 08:15:03 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:15:03 user nova-compute[72426]:   </features>
Aug 01 08:15:03 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:15:03 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:15:03 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:15:03 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:15:03 user nova-compute[72426]:   </clock>
Aug 01 08:15:03 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:15:03 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:15:03 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:15:03 user nova-compute[72426]:   </cpu>
Aug 01 08:15:03 user nova-compute[72426]:   <devices>
Aug 01 08:15:03 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:15:03 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:15:03 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk"/>
Aug 01 08:15:03 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:15:03 user nova-compute[72426]:     </disk>
Aug 01 08:15:03 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:15:03 user nova-compute[72426]:       <mac address="fa:16:3e:12:59:ce"/>
Aug 01 08:15:03 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:15:03 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:15:03 user nova-compute[72426]:       <target dev="tap60c608b0-46"/>
Aug 01 08:15:03 user nova-compute[72426]:     </interface>
Aug 01 08:15:03 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:15:03 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/console.log" append="off"/>
Aug 01 08:15:03 user nova-compute[72426]:     </serial>
Aug 01 08:15:03 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:15:03 user nova-compute[72426]:     <video>
Aug 01 08:15:03 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:15:03 user nova-compute[72426]:     </video>
Aug 01 08:15:03 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:15:03 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:15:03 user nova-compute[72426]:     </rng>
Aug 01 08:15:03 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:15:03 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:15:03 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:15:03 user nova-compute[72426]:     </memballoon>
Aug 01 08:15:03 user nova-compute[72426]:   </devices>
Aug 01 08:15:03 user nova-compute[72426]: </domain>
Aug 01 08:15:03 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1912323582',display_name='tempest-VolumesActionsTest-instance-1912323582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1912323582',id=20,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc2a913710a44a50927c9e68e9807367',ramdisk_id='',reservation_id='r-cqe3ndse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-55827117',owner_user_name='tempest-VolumesActionsTest-55827117-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:15:01Z,user_data=None,user_id='2845bfd89e8e4057ac9464f5bf3b52be',uuid=0debd99f-9724-42ed-8048-857edce10e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c608b0-461b-46e4-b127-189bee33d399", "address": "fa:16:3e:12:59:ce", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c608b0-46", "ovs_interfaceid": "60c608b0-461b-46e4-b127-189bee33d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converting VIF {"id": "60c608b0-461b-46e4-b127-189bee33d399", "address": "fa:16:3e:12:59:ce", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c608b0-46", "ovs_interfaceid": "60c608b0-461b-46e4-b127-189bee33d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:59:ce,bridge_name='br-int',has_traffic_filtering=True,id=60c608b0-461b-46e4-b127-189bee33d399,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c608b0-46') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG os_vif [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:59:ce,bridge_name='br-int',has_traffic_filtering=True,id=60c608b0-461b-46e4-b127-189bee33d399,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c608b0-46') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60c608b0-46, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60c608b0-46, col_values=(('external_ids', {'iface-id': '60c608b0-461b-46e4-b127-189bee33d399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:59:ce', 'vm-uuid': '0debd99f-9724-42ed-8048-857edce10e6f'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:03 user nova-compute[72426]: INFO os_vif [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:59:ce,bridge_name='br-int',has_traffic_filtering=True,id=60c608b0-461b-46e4-b127-189bee33d399,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c608b0-46')
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] No VIF found with MAC fa:16:3e:12:59:ce, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.network.neutron [req-1e0288f6-17a9-4c95-bbf5-33c3f0e212d6 req-c7a587cd-6a5d-4a23-867d-5a620000fdfa service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Updated VIF entry in instance network info cache for port 60c608b0-461b-46e4-b127-189bee33d399. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG nova.network.neutron [req-1e0288f6-17a9-4c95-bbf5-33c3f0e212d6 req-c7a587cd-6a5d-4a23-867d-5a620000fdfa service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Updating instance_info_cache with network_info: [{"id": "60c608b0-461b-46e4-b127-189bee33d399", "address": "fa:16:3e:12:59:ce", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c608b0-46", "ovs_interfaceid": "60c608b0-461b-46e4-b127-189bee33d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1e0288f6-17a9-4c95-bbf5-33c3f0e212d6 req-c7a587cd-6a5d-4a23-867d-5a620000fdfa service nova] Releasing lock "refresh_cache-0debd99f-9724-42ed-8048-857edce10e6f" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:15:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-59803819-2fdc-4c46-bf2e-7e420938082e req-88c37c77-eba1-4de9-b24a-d574e37cedce service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Received event network-vif-plugged-60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59803819-2fdc-4c46-bf2e-7e420938082e req-88c37c77-eba1-4de9-b24a-d574e37cedce service nova] Acquiring lock "0debd99f-9724-42ed-8048-857edce10e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59803819-2fdc-4c46-bf2e-7e420938082e req-88c37c77-eba1-4de9-b24a-d574e37cedce service nova] Lock "0debd99f-9724-42ed-8048-857edce10e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59803819-2fdc-4c46-bf2e-7e420938082e req-88c37c77-eba1-4de9-b24a-d574e37cedce service nova] Lock "0debd99f-9724-42ed-8048-857edce10e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-59803819-2fdc-4c46-bf2e-7e420938082e req-88c37c77-eba1-4de9-b24a-d574e37cedce service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] No waiting events found dispatching network-vif-plugged-60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:05 user nova-compute[72426]: WARNING nova.compute.manager [req-59803819-2fdc-4c46-bf2e-7e420938082e req-88c37c77-eba1-4de9-b24a-d574e37cedce service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Received unexpected event network-vif-plugged-60c608b0-461b-46e4-b127-189bee33d399 for instance with vm_state building and task_state spawning.
Aug 01 08:15:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877707.1237104, 0debd99f-9724-42ed-8048-857edce10e6f => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] VM Resumed (Lifecycle Event)
Aug 01 08:15:07 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Instance spawned successfully.
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-bbfc20ce-680a-4f62-afd3-52c931bf5167 req-69fa34ab-93a8-476a-8d5e-13f4a01f99be service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Received event network-vif-plugged-60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bbfc20ce-680a-4f62-afd3-52c931bf5167 req-69fa34ab-93a8-476a-8d5e-13f4a01f99be service nova] Acquiring lock "0debd99f-9724-42ed-8048-857edce10e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bbfc20ce-680a-4f62-afd3-52c931bf5167 req-69fa34ab-93a8-476a-8d5e-13f4a01f99be service nova] Lock "0debd99f-9724-42ed-8048-857edce10e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bbfc20ce-680a-4f62-afd3-52c931bf5167 req-69fa34ab-93a8-476a-8d5e-13f4a01f99be service nova] Lock "0debd99f-9724-42ed-8048-857edce10e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-bbfc20ce-680a-4f62-afd3-52c931bf5167 req-69fa34ab-93a8-476a-8d5e-13f4a01f99be service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] No waiting events found dispatching network-vif-plugged-60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:07 user nova-compute[72426]: WARNING nova.compute.manager [req-bbfc20ce-680a-4f62-afd3-52c931bf5167 req-69fa34ab-93a8-476a-8d5e-13f4a01f99be service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Received unexpected event network-vif-plugged-60c608b0-461b-46e4-b127-189bee33d399 for instance with vm_state building and task_state spawning.
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:15:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877707.1241899, 0debd99f-9724-42ed-8048-857edce10e6f => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] VM Started (Lifecycle Event)
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:15:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:15:07 user nova-compute[72426]: INFO nova.compute.manager [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Took 5.70 seconds to spawn the instance on the hypervisor.
Aug 01 08:15:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:07 user nova-compute[72426]: INFO nova.compute.manager [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Took 6.72 seconds to build instance.
Aug 01 08:15:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3db48889-4f66-480e-bfa9-b637c8620536 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "0debd99f-9724-42ed-8048-857edce10e6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.929s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Acquiring lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Acquiring lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:10 user nova-compute[72426]: INFO nova.compute.manager [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Terminating instance
Aug 01 08:15:10 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:15:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-186dc843-0524-43e5-bf65-7cd75bb5fa27 req-588cfd93-765a-4c49-9480-e019a2abfa11 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Received event network-vif-unplugged-664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-186dc843-0524-43e5-bf65-7cd75bb5fa27 req-588cfd93-765a-4c49-9480-e019a2abfa11 service nova] Acquiring lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-186dc843-0524-43e5-bf65-7cd75bb5fa27 req-588cfd93-765a-4c49-9480-e019a2abfa11 service nova] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-186dc843-0524-43e5-bf65-7cd75bb5fa27 req-588cfd93-765a-4c49-9480-e019a2abfa11 service nova] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-186dc843-0524-43e5-bf65-7cd75bb5fa27 req-588cfd93-765a-4c49-9480-e019a2abfa11 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] No waiting events found dispatching network-vif-unplugged-664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-186dc843-0524-43e5-bf65-7cd75bb5fa27 req-588cfd93-765a-4c49-9480-e019a2abfa11 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Received event network-vif-unplugged-664c8280-fcb3-4780-9423-3c0da75c7914 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:15:11 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Instance destroyed successfully.
Aug 01 08:15:11 user nova-compute[72426]: DEBUG nova.objects.instance [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lazy-loading 'resources' on Instance uuid 3b0a5550-8c33-4d45-846f-45cfe9fffe67 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-500195728',display_name='tempest-VolumesNegativeTest-instance-500195728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-500195728',id=16,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:13:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7b1df9ce60249cea01647895d5692a8',ramdisk_id='',reservation_id='r-q0051rkb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1735639455',owner_user_name='tempest-VolumesNegativeTest-1735639455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:13:33Z,user_data=None,user_id='391a62ae030343ce8f2a36488f410277',uuid=3b0a5550-8c33-4d45-846f-45cfe9fffe67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "664c8280-fcb3-4780-9423-3c0da75c7914", "address": "fa:16:3e:ef:86:bd", "network": {"id": "a908629a-9f6d-4bef-afdc-065c57ef8b04", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "197aa2b20aa8460e817aa3af6d070fcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664c8280-fc", "ovs_interfaceid": "664c8280-fcb3-4780-9423-3c0da75c7914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Converting VIF {"id": "664c8280-fcb3-4780-9423-3c0da75c7914", "address": "fa:16:3e:ef:86:bd", "network": {"id": "a908629a-9f6d-4bef-afdc-065c57ef8b04", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.46", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "197aa2b20aa8460e817aa3af6d070fcc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap664c8280-fc", "ovs_interfaceid": "664c8280-fcb3-4780-9423-3c0da75c7914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:bd,bridge_name='br-int',has_traffic_filtering=True,id=664c8280-fcb3-4780-9423-3c0da75c7914,network=Network(a908629a-9f6d-4bef-afdc-065c57ef8b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664c8280-fc') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG os_vif [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:bd,bridge_name='br-int',has_traffic_filtering=True,id=664c8280-fcb3-4780-9423-3c0da75c7914,network=Network(a908629a-9f6d-4bef-afdc-065c57ef8b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664c8280-fc') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap664c8280-fc, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:15:11 user nova-compute[72426]: INFO os_vif [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:bd,bridge_name='br-int',has_traffic_filtering=True,id=664c8280-fcb3-4780-9423-3c0da75c7914,network=Network(a908629a-9f6d-4bef-afdc-065c57ef8b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap664c8280-fc')
Aug 01 08:15:11 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Deleting instance files /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67_del
Aug 01 08:15:11 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Deletion of /opt/stack/data/nova/instances/3b0a5550-8c33-4d45-846f-45cfe9fffe67_del complete
Aug 01 08:15:11 user nova-compute[72426]: INFO nova.compute.manager [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 08:15:11 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:15:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:12 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:12 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Took 0.72 seconds to deallocate network for instance.
Aug 01 08:15:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-e6a6f11a-631f-4caa-9e98-6410f6ba3fc5 req-62efaa19-45ba-42dc-ac27-e27e8a5d2423 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Received event network-vif-deleted-664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:12 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:15:12 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:15:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:12 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Deleted allocations for instance 3b0a5550-8c33-4d45-846f-45cfe9fffe67
Aug 01 08:15:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9813b16b-b073-41ee-bac8-8fcb0fd6c3f7 tempest-VolumesNegativeTest-1735639455 tempest-VolumesNegativeTest-1735639455-project-member] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.333s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-fca02a6d-2528-40de-b13a-c94b983a8a6b req-f50d40b1-4d25-4acc-9c05-4dca72031674 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Received event network-vif-plugged-664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fca02a6d-2528-40de-b13a-c94b983a8a6b req-f50d40b1-4d25-4acc-9c05-4dca72031674 service nova] Acquiring lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fca02a6d-2528-40de-b13a-c94b983a8a6b req-f50d40b1-4d25-4acc-9c05-4dca72031674 service nova] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fca02a6d-2528-40de-b13a-c94b983a8a6b req-f50d40b1-4d25-4acc-9c05-4dca72031674 service nova] Lock "3b0a5550-8c33-4d45-846f-45cfe9fffe67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-fca02a6d-2528-40de-b13a-c94b983a8a6b req-f50d40b1-4d25-4acc-9c05-4dca72031674 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] No waiting events found dispatching network-vif-plugged-664c8280-fcb3-4780-9423-3c0da75c7914 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:13 user nova-compute[72426]: WARNING nova.compute.manager [req-fca02a6d-2528-40de-b13a-c94b983a8a6b req-f50d40b1-4d25-4acc-9c05-4dca72031674 service nova] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Received unexpected event network-vif-plugged-664c8280-fcb3-4780-9423-3c0da75c7914 for instance with vm_state deleted and task_state None.
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:13 user nova-compute[72426]: INFO nova.compute.manager [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Terminating instance
Aug 01 08:15:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-d6822d49-f085-480c-beeb-d378274e669c req-af416b63-7659-43d6-9b18-06fb49ad4bd4 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received event network-vif-unplugged-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d6822d49-f085-480c-beeb-d378274e669c req-af416b63-7659-43d6-9b18-06fb49ad4bd4 service nova] Acquiring lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d6822d49-f085-480c-beeb-d378274e669c req-af416b63-7659-43d6-9b18-06fb49ad4bd4 service nova] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d6822d49-f085-480c-beeb-d378274e669c req-af416b63-7659-43d6-9b18-06fb49ad4bd4 service nova] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-d6822d49-f085-480c-beeb-d378274e669c req-af416b63-7659-43d6-9b18-06fb49ad4bd4 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] No waiting events found dispatching network-vif-unplugged-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-d6822d49-f085-480c-beeb-d378274e669c req-af416b63-7659-43d6-9b18-06fb49ad4bd4 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received event network-vif-unplugged-0e7037af-0c00-4388-a819-04af9c0a565c for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:15:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Instance destroyed successfully.
Aug 01 08:15:14 user nova-compute[72426]: DEBUG nova.objects.instance [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lazy-loading 'resources' on Instance uuid 457df7dd-4e0f-4d72-915b-644f0c8588eb {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-989886833',display_name='tempest-VolumesAdminNegativeTest-server-989886833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-989886833',id=6,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdSLoGwqDXfCm2qME6VlQAsvKozbYJlIeEbiJY6y1/uBXlWpKrRwulLQsl7OV3TH4qRQgkMCsNXjhe3DGSBulcCdKoXkTzLLE7fMITb1gjZCsUB/wORpne6ILnW1dOoCQ==',key_name='tempest-keypair-1370144311',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:09:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebec9a843238456ca5d7fdf893326c4f',ramdisk_id='',reservation_id='r-4nx78hsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-336374183',owner_user_name='tempest-VolumesAdminNegativeTest-336374183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b37a9ddbd9454c0996c1271a13c941d4',uuid=457df7dd-4e0f-4d72-915b-644f0c8588eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:15:14 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converting VIF {"id": "0e7037af-0c00-4388-a819-04af9c0a565c", "address": "fa:16:3e:db:1c:0b", "network": {"id": "c9d20155-9a20-4344-a34f-cf146e403da1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-766673567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebec9a843238456ca5d7fdf893326c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7037af-0c", "ovs_interfaceid": "0e7037af-0c00-4388-a819-04af9c0a565c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:15:14 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:1c:0b,bridge_name='br-int',has_traffic_filtering=True,id=0e7037af-0c00-4388-a819-04af9c0a565c,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7037af-0c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:15:14 user nova-compute[72426]: DEBUG os_vif [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:1c:0b,bridge_name='br-int',has_traffic_filtering=True,id=0e7037af-0c00-4388-a819-04af9c0a565c,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7037af-0c') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:15:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e7037af-0c, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:15:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:15:14 user nova-compute[72426]: INFO os_vif [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:1c:0b,bridge_name='br-int',has_traffic_filtering=True,id=0e7037af-0c00-4388-a819-04af9c0a565c,network=Network(c9d20155-9a20-4344-a34f-cf146e403da1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7037af-0c')
Aug 01 08:15:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Deleting instance files /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb_del
Aug 01 08:15:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Deletion of /opt/stack/data/nova/instances/457df7dd-4e0f-4d72-915b-644f0c8588eb_del complete
Aug 01 08:15:14 user nova-compute[72426]: INFO nova.compute.manager [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 08:15:14 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:15:14 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:15:14 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:15 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Took 1.07 seconds to deallocate network for instance.
Aug 01 08:15:15 user nova-compute[72426]: DEBUG nova.compute.manager [req-ce5d2174-cebb-4938-bfb3-7d5011636401 req-cad394f3-92c0-4a2a-bd4b-dd717b475afa service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received event network-vif-deleted-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG nova.compute.manager [req-0f54793b-47f8-4145-a5a2-672b07e87dbb req-63db24d3-24d4-47f9-9d73-ea121ac13d36 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received event network-vif-plugged-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f54793b-47f8-4145-a5a2-672b07e87dbb req-63db24d3-24d4-47f9-9d73-ea121ac13d36 service nova] Acquiring lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f54793b-47f8-4145-a5a2-672b07e87dbb req-63db24d3-24d4-47f9-9d73-ea121ac13d36 service nova] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f54793b-47f8-4145-a5a2-672b07e87dbb req-63db24d3-24d4-47f9-9d73-ea121ac13d36 service nova] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:15 user nova-compute[72426]: DEBUG nova.compute.manager [req-0f54793b-47f8-4145-a5a2-672b07e87dbb req-63db24d3-24d4-47f9-9d73-ea121ac13d36 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] No waiting events found dispatching network-vif-plugged-0e7037af-0c00-4388-a819-04af9c0a565c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:15 user nova-compute[72426]: WARNING nova.compute.manager [req-0f54793b-47f8-4145-a5a2-672b07e87dbb req-63db24d3-24d4-47f9-9d73-ea121ac13d36 service nova] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Received unexpected event network-vif-plugged-0e7037af-0c00-4388-a819-04af9c0a565c for instance with vm_state deleted and task_state None.
Aug 01 08:15:15 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Deleted allocations for instance 457df7dd-4e0f-4d72-915b-644f0c8588eb
Aug 01 08:15:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0cb89103-faaa-4bb5-84d8-149e64774dd6 tempest-VolumesAdminNegativeTest-336374183 tempest-VolumesAdminNegativeTest-336374183-project-member] Lock "457df7dd-4e0f-4d72-915b-644f0c8588eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.712s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid c10d6140-aa17-4342-9135-d07a73285483 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid f826ffe7-92dc-4f05-9298-1236513a1af2 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid b25da8d6-1222-4856-bda1-e0e51c69f26d {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 2236c44a-562a-4b67-a487-ad51180dbaa0 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 0debd99f-9724-42ed-8048-857edce10e6f {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "c10d6140-aa17-4342-9135-d07a73285483" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "c10d6140-aa17-4342-9135-d07a73285483" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "2236c44a-562a-4b67-a487-ad51180dbaa0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "0debd99f-9724-42ed-8048-857edce10e6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "0debd99f-9724-42ed-8048-857edce10e6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "c10d6140-aa17-4342-9135-d07a73285483" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "0debd99f-9724-42ed-8048-857edce10e6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:20 user nova-compute[72426]: INFO nova.compute.manager [None req-c2491c98-7c4c-4f42-a65f-7b832b94ac25 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Unrescuing
Aug 01 08:15:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c2491c98-7c4c-4f42-a65f-7b832b94ac25 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:15:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c2491c98-7c4c-4f42-a65f-7b832b94ac25 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquired lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:15:20 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c2491c98-7c4c-4f42-a65f-7b832b94ac25 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-c2491c98-7c4c-4f42-a65f-7b832b94ac25 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updating instance_info_cache with network_info: [{"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c2491c98-7c4c-4f42-a65f-7b832b94ac25 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Releasing lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG nova.objects.instance [None req-c2491c98-7c4c-4f42-a65f-7b832b94ac25 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'flavor' on Instance uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-34f22d46-92d2-44fa-a6bd-bb874797c618 req-a805cfc9-f083-49b0-9933-216d42ad11aa service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-unplugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-34f22d46-92d2-44fa-a6bd-bb874797c618 req-a805cfc9-f083-49b0-9933-216d42ad11aa service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-34f22d46-92d2-44fa-a6bd-bb874797c618 req-a805cfc9-f083-49b0-9933-216d42ad11aa service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-34f22d46-92d2-44fa-a6bd-bb874797c618 req-a805cfc9-f083-49b0-9933-216d42ad11aa service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-34f22d46-92d2-44fa-a6bd-bb874797c618 req-a805cfc9-f083-49b0-9933-216d42ad11aa service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-unplugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:21 user nova-compute[72426]: WARNING nova.compute.manager [req-34f22d46-92d2-44fa-a6bd-bb874797c618 req-a805cfc9-f083-49b0-9933-216d42ad11aa service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-unplugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:15:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:21 user nova-compute[72426]: INFO nova.compute.manager [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Terminating instance
Aug 01 08:15:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-3cb8eb2e-e024-4875-9245-8656adc9e0df req-3cce2fbe-5ad0-46b7-bde6-f580ebb04947 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received event network-vif-unplugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3cb8eb2e-e024-4875-9245-8656adc9e0df req-3cce2fbe-5ad0-46b7-bde6-f580ebb04947 service nova] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3cb8eb2e-e024-4875-9245-8656adc9e0df req-3cce2fbe-5ad0-46b7-bde6-f580ebb04947 service nova] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3cb8eb2e-e024-4875-9245-8656adc9e0df req-3cce2fbe-5ad0-46b7-bde6-f580ebb04947 service nova] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-3cb8eb2e-e024-4875-9245-8656adc9e0df req-3cce2fbe-5ad0-46b7-bde6-f580ebb04947 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] No waiting events found dispatching network-vif-unplugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-3cb8eb2e-e024-4875-9245-8656adc9e0df req-3cce2fbe-5ad0-46b7-bde6-f580ebb04947 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received event network-vif-unplugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:15:22 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Instance destroyed successfully.
Aug 01 08:15:22 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Instance destroyed successfully.
Aug 01 08:15:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lazy-loading 'resources' on Instance uuid f826ffe7-92dc-4f05-9298-1236513a1af2 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:09:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-227999925',display_name='tempest-TestVolumeSwap-server-227999925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-227999925',id=8,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjeJVzeeno6AmMMX0kdxdclc9K/mX7j7fsOWkX1M8Nic78znnbGcL+WjNGXmm6IlwowlFy7ZkI9+lBlMe5i6qbKi8Wwrx5tHfVxNdEnjN1qBS7TbMy3psRG6x1D5A/3LQ==',key_name='tempest-keypair-1928294829',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:09:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faa3149b4b4b4c978f6af96161dadce7',ramdisk_id='',reservation_id='r-9fl951p7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-669238879',owner_user_name='tempest-TestVolumeSwap-669238879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1e2c0341b2e04acc91fecdce1a6575b1',uuid=f826ffe7-92dc-4f05-9298-1236513a1af2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Converting VIF {"id": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "address": "fa:16:3e:c4:2d:40", "network": {"id": "9adff86d-4f28-46e5-94c5-1efe0cf0ab5d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1396067212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faa3149b4b4b4c978f6af96161dadce7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624f3e1-a1", "ovs_interfaceid": "b624f3e1-a1cb-4147-89de-7f2bf45ac4c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:2d:40,bridge_name='br-int',has_traffic_filtering=True,id=b624f3e1-a1cb-4147-89de-7f2bf45ac4c8,network=Network(9adff86d-4f28-46e5-94c5-1efe0cf0ab5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624f3e1-a1') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG os_vif [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:2d:40,bridge_name='br-int',has_traffic_filtering=True,id=b624f3e1-a1cb-4147-89de-7f2bf45ac4c8,network=Network(9adff86d-4f28-46e5-94c5-1efe0cf0ab5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624f3e1-a1') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb624f3e1-a1, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:23 user nova-compute[72426]: INFO os_vif [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:2d:40,bridge_name='br-int',has_traffic_filtering=True,id=b624f3e1-a1cb-4147-89de-7f2bf45ac4c8,network=Network(9adff86d-4f28-46e5-94c5-1efe0cf0ab5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624f3e1-a1')
Aug 01 08:15:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Deleting instance files /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2_del
Aug 01 08:15:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Deletion of /opt/stack/data/nova/instances/f826ffe7-92dc-4f05-9298-1236513a1af2_del complete
Aug 01 08:15:23 user nova-compute[72426]: INFO nova.compute.manager [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Took 1.44 seconds to destroy the instance on the hypervisor.
Aug 01 08:15:23 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-8297a47d-540c-4789-83c2-71e46d712ff4 req-ef921dd6-a39a-4bb7-b9b4-67062dc92a91 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8297a47d-540c-4789-83c2-71e46d712ff4 req-ef921dd6-a39a-4bb7-b9b4-67062dc92a91 service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8297a47d-540c-4789-83c2-71e46d712ff4 req-ef921dd6-a39a-4bb7-b9b4-67062dc92a91 service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8297a47d-540c-4789-83c2-71e46d712ff4 req-ef921dd6-a39a-4bb7-b9b4-67062dc92a91 service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-8297a47d-540c-4789-83c2-71e46d712ff4 req-ef921dd6-a39a-4bb7-b9b4-67062dc92a91 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:23 user nova-compute[72426]: WARNING nova.compute.manager [req-8297a47d-540c-4789-83c2-71e46d712ff4 req-ef921dd6-a39a-4bb7-b9b4-67062dc92a91 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:15:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-a787af7d-2d40-4423-8c8f-2c58f38ed3a9 req-47d9d9bf-5058-42e0-a4de-03abfd805a4b service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received event network-vif-plugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a787af7d-2d40-4423-8c8f-2c58f38ed3a9 req-47d9d9bf-5058-42e0-a4de-03abfd805a4b service nova] Acquiring lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a787af7d-2d40-4423-8c8f-2c58f38ed3a9 req-47d9d9bf-5058-42e0-a4de-03abfd805a4b service nova] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a787af7d-2d40-4423-8c8f-2c58f38ed3a9 req-47d9d9bf-5058-42e0-a4de-03abfd805a4b service nova] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-a787af7d-2d40-4423-8c8f-2c58f38ed3a9 req-47d9d9bf-5058-42e0-a4de-03abfd805a4b service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] No waiting events found dispatching network-vif-plugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:24 user nova-compute[72426]: WARNING nova.compute.manager [req-a787af7d-2d40-4423-8c8f-2c58f38ed3a9 req-47d9d9bf-5058-42e0-a4de-03abfd805a4b service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received unexpected event network-vif-plugged-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 for instance with vm_state active and task_state deleting.
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:24 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Took 1.08 seconds to deallocate network for instance.
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-ad8c931a-575b-4299-8c2d-879fb0787c3c req-63a67df6-b96e-4e88-a3fa-668c3537d678 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Received event network-vif-deleted-b624f3e1-a1cb-4147-89de-7f2bf45ac4c8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:24 user nova-compute[72426]: INFO nova.compute.manager [req-ad8c931a-575b-4299-8c2d-879fb0787c3c req-63a67df6-b96e-4e88-a3fa-668c3537d678 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Neutron deleted interface b624f3e1-a1cb-4147-89de-7f2bf45ac4c8; detaching it from the instance and deleting it from the info cache
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.network.neutron [req-ad8c931a-575b-4299-8c2d-879fb0787c3c req-63a67df6-b96e-4e88-a3fa-668c3537d678 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-ad8c931a-575b-4299-8c2d-879fb0787c3c req-63a67df6-b96e-4e88-a3fa-668c3537d678 service nova] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Detach interface failed, port_id=b624f3e1-a1cb-4147-89de-7f2bf45ac4c8, reason: Instance f826ffe7-92dc-4f05-9298-1236513a1af2 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:24 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Deleted allocations for instance f826ffe7-92dc-4f05-9298-1236513a1af2
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e876b8f-364d-476f-b484-12c3463291b1 tempest-TestVolumeSwap-669238879 tempest-TestVolumeSwap-669238879-project-member] Lock "f826ffe7-92dc-4f05-9298-1236513a1af2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.277s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:25 user nova-compute[72426]: WARNING nova.compute.manager [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:25 user nova-compute[72426]: WARNING nova.compute.manager [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received event network-changed-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Refreshing instance network info cache due to event network-changed-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] Acquiring lock "refresh_cache-2236c44a-562a-4b67-a487-ad51180dbaa0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] Acquired lock "refresh_cache-2236c44a-562a-4b67-a487-ad51180dbaa0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.network.neutron [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Refreshing network info cache for port af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877725.7586083, 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] VM Resumed (Lifecycle Event)
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c2491c98-7c4c-4f42-a65f-7b832b94ac25 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:15:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877725.7596612, 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] VM Started (Lifecycle Event)
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877711.4872696, 3b0a5550-8c33-4d45-846f-45cfe9fffe67 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:26 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] VM Stopped (Lifecycle Event)
Aug 01 08:15:26 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:15:26 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7177MB free_disk=25.697277069091797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-5854c3e2-e76c-42dd-838f-149010787263 None None] [instance: 3b0a5550-8c33-4d45-846f-45cfe9fffe67] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance b25da8d6-1222-4856-bda1-e0e51c69f26d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2236c44a-562a-4b67-a487-ad51180dbaa0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0debd99f-9724-42ed-8048-857edce10e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.network.neutron [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Updated VIF entry in instance network info cache for port af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG nova.network.neutron [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Updating instance_info_cache with network_info: [{"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2795cd3f-17b9-4c48-9c5e-028e87ed2944 req-617aad47-e307-45c6-b61b-ee5ccb92c623 service nova] Releasing lock "refresh_cache-2236c44a-562a-4b67-a487-ad51180dbaa0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:15:27 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:15:27 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:15:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:15:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:28 user nova-compute[72426]: INFO nova.compute.manager [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Detaching volume 65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3
Aug 01 08:15:28 user nova-compute[72426]: INFO nova.virt.block_device [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Attempting to driver detach volume 65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 from mountpoint /dev/vdb
Aug 01 08:15:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Attempting to detach device vdb from instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:15:28 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:15:28 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:15:28 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:15:28 user nova-compute[72426]:   <serial>65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3</serial>
Aug 01 08:15:28 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 08:15:28 user nova-compute[72426]: </disk>
Aug 01 08:15:28 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:15:28 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully detached device vdb from instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d from the persistent domain config.
Aug 01 08:15:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:15:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:15:28 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:15:28 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:15:28 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:15:28 user nova-compute[72426]:   <serial>65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3</serial>
Aug 01 08:15:28 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 08:15:28 user nova-compute[72426]: </disk>
Aug 01 08:15:28 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877714.1765592, 457df7dd-4e0f-4d72-915b-644f0c8588eb => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:29 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] VM Stopped (Lifecycle Event)
Aug 01 08:15:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-1f79401d-22d0-4b54-afcd-216a2874ac17 None None] [instance: 457df7dd-4e0f-4d72-915b-644f0c8588eb] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690877729.2866843, df66e0b7-acbf-48a2-b165-7d4a4fbf790d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:15:29 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully detached device vdb from instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d from the live domain config.
Aug 01 08:15:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScfqmYZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:15:29 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[073df277-9612-4d9d-8084-890c7f78235b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b37b51e-0be7-483b-80ef-24256be1f846]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:15:29 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:15:29 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:15:29 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c54c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d867b2b-a98e-40a4-a2a4-ad216d32070c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe5c414-3a0f-4af9-aaba-c98066fe6ff5]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee729289-5c11-4a96-93f9-4ad73c5c8f92]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9a270a-ac88-4865-8c45-ba8bfbed76d1]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3b6030-115e-4bb6-af39-57533e90c758]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e718df-7587-461a-a6ce-dc9cb7fa47d8]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260]
Aug 01 08:15:29 user nova-compute[72426]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3, portal: 172.16.0.220,3260] successful.
Aug 01 08:15:29 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65da3576-eb2b-4d98-a8dd-4d3f9d28f1e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9f5828-8d85-4fe7-94f8-74a007d750d1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== disconnect_volume: return (331ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:15:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:15:30 user nova-compute[72426]: DEBUG nova.objects.instance [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'flavor' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b08b035c-b959-4bfe-a2ca-25137ce2200e tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:30 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:15:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "551a28bf-12d3-419b-bfb9-6e10647de1ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:15:33 user nova-compute[72426]: INFO nova.compute.claims [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Claim successful on node user
Aug 01 08:15:33 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:15:33 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:15:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG nova.network.neutron [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:15:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:15:33 user nova-compute[72426]: INFO nova.virt.block_device [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Booting with volume snapshot 258197ba-6e5a-4dda-9e96-6c6ae7fc6742 at /dev/vda
Aug 01 08:15:33 user nova-compute[72426]: DEBUG nova.policy [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49f9ffcf2a8a435a968fd41590d90607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f71856fa7cb47b998a77b3f4ba436d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:15:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Successfully created port: 67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:15:35 user nova-compute[72426]: INFO nova.compute.manager [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Rescuing
Aug 01 08:15:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquired lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG nova.network.neutron [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG nova.network.neutron [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Successfully updated port: 67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "refresh_cache-551a28bf-12d3-419b-bfb9-6e10647de1ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquired lock "refresh_cache-551a28bf-12d3-419b-bfb9-6e10647de1ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG nova.network.neutron [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-54151ff0-8a3f-41cc-93a2-a152bf5855e1 req-a2522ced-e9a6-47f6-ada0-082d6daea1de service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received event network-changed-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-54151ff0-8a3f-41cc-93a2-a152bf5855e1 req-a2522ced-e9a6-47f6-ada0-082d6daea1de service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Refreshing instance network info cache due to event network-changed-67f23dc9-1d5d-49d5-af3e-eefebe684941. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-54151ff0-8a3f-41cc-93a2-a152bf5855e1 req-a2522ced-e9a6-47f6-ada0-082d6daea1de service nova] Acquiring lock "refresh_cache-551a28bf-12d3-419b-bfb9-6e10647de1ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG nova.network.neutron [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Updating instance_info_cache with network_info: [{"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG nova.network.neutron [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:15:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Releasing lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Updating instance_info_cache with network_info: [{"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Releasing lock "refresh_cache-551a28bf-12d3-419b-bfb9-6e10647de1ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Instance network_info: |[{"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-54151ff0-8a3f-41cc-93a2-a152bf5855e1 req-a2522ced-e9a6-47f6-ada0-082d6daea1de service nova] Acquired lock "refresh_cache-551a28bf-12d3-419b-bfb9-6e10647de1ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.network.neutron [req-54151ff0-8a3f-41cc-93a2-a152bf5855e1 req-a2522ced-e9a6-47f6-ada0-082d6daea1de service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Refreshing network info cache for port 67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-d4e962d3-e4cf-41e3-b1ad-456ba3b2b158 req-0f1f9490-850a-4c00-b7ba-f1881efc9664 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-vif-unplugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d4e962d3-e4cf-41e3-b1ad-456ba3b2b158 req-0f1f9490-850a-4c00-b7ba-f1881efc9664 service nova] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d4e962d3-e4cf-41e3-b1ad-456ba3b2b158 req-0f1f9490-850a-4c00-b7ba-f1881efc9664 service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d4e962d3-e4cf-41e3-b1ad-456ba3b2b158 req-0f1f9490-850a-4c00-b7ba-f1881efc9664 service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-d4e962d3-e4cf-41e3-b1ad-456ba3b2b158 req-0f1f9490-850a-4c00-b7ba-f1881efc9664 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] No waiting events found dispatching network-vif-unplugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:36 user nova-compute[72426]: WARNING nova.compute.manager [req-d4e962d3-e4cf-41e3-b1ad-456ba3b2b158 req-0f1f9490-850a-4c00-b7ba-f1881efc9664 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received unexpected event network-vif-unplugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 for instance with vm_state active and task_state rescuing.
Aug 01 08:15:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Instance destroyed successfully.
Aug 01 08:15:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Attempting rescue
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72426) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Instance directory exists: not creating {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 08:15:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Creating image(s)
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'trusted_certs' on Instance uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.network.neutron [req-54151ff0-8a3f-41cc-93a2-a152bf5855e1 req-a2522ced-e9a6-47f6-ada0-082d6daea1de service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Updated VIF entry in instance network info cache for port 67f23dc9-1d5d-49d5-af3e-eefebe684941. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.network.neutron [req-54151ff0-8a3f-41cc-93a2-a152bf5855e1 req-a2522ced-e9a6-47f6-ada0-082d6daea1de service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Updating instance_info_cache with network_info: [{"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue" returned: 0 in 0.054s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'migration_context' on Instance uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-54151ff0-8a3f-41cc-93a2-a152bf5855e1 req-a2522ced-e9a6-47f6-ada0-082d6daea1de service nova] Releasing lock "refresh_cache-551a28bf-12d3-419b-bfb9-6e10647de1ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Start _get_guest_xml network_info=[{"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "vif_mac": "fa:16:3e:64:b6:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'resources' on Instance uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'numa_topology' on Instance uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:36 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:15:36 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:15:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'vcpu_model' on Instance uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308070890',display_name='tempest-ServerRescueNegativeTestJSON-server-1308070890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308070890',id=19,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-zdo8fa50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:54Z,user_data=None,user_id='e024ff90ae7148819d1d518d3754733f',uuid=bbb82852-01b7-4609-95a3-f8f36cebbf7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "vif_mac": "fa:16:3e:64:b6:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:15:37 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "vif_mac": "fa:16:3e:64:b6:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:15:37 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:b6:08,bridge_name='br-int',has_traffic_filtering=True,id=de38d532-38d7-42b6-92cd-1c65a2d551b1,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde38d532-38') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:15:37 user nova-compute[72426]: DEBUG nova.objects.instance [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'pci_devices' on Instance uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:15:37 user nova-compute[72426]:   <uuid>bbb82852-01b7-4609-95a3-f8f36cebbf7d</uuid>
Aug 01 08:15:37 user nova-compute[72426]:   <name>instance-00000013</name>
Aug 01 08:15:37 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:15:37 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:15:37 user nova-compute[72426]:   <metadata>
Aug 01 08:15:37 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:15:37 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:15:37 user nova-compute[72426]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1308070890</nova:name>
Aug 01 08:15:37 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:15:36</nova:creationTime>
Aug 01 08:15:37 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:15:37 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:15:37 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:15:37 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:15:37 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:15:37 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:15:37 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:15:37 user nova-compute[72426]:       <nova:owner>
Aug 01 08:15:37 user nova-compute[72426]:         <nova:user uuid="e024ff90ae7148819d1d518d3754733f">tempest-ServerRescueNegativeTestJSON-1267015268-project-member</nova:user>
Aug 01 08:15:37 user nova-compute[72426]:         <nova:project uuid="ba9024541f804b259eeed3f2dd0ce12f">tempest-ServerRescueNegativeTestJSON-1267015268</nova:project>
Aug 01 08:15:37 user nova-compute[72426]:       </nova:owner>
Aug 01 08:15:37 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:15:37 user nova-compute[72426]:       <nova:ports>
Aug 01 08:15:37 user nova-compute[72426]:         <nova:port uuid="de38d532-38d7-42b6-92cd-1c65a2d551b1">
Aug 01 08:15:37 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 08:15:37 user nova-compute[72426]:         </nova:port>
Aug 01 08:15:37 user nova-compute[72426]:       </nova:ports>
Aug 01 08:15:37 user nova-compute[72426]:     </nova:instance>
Aug 01 08:15:37 user nova-compute[72426]:   </metadata>
Aug 01 08:15:37 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:15:37 user nova-compute[72426]:     <system>
Aug 01 08:15:37 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:15:37 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:15:37 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:15:37 user nova-compute[72426]:       <entry name="serial">bbb82852-01b7-4609-95a3-f8f36cebbf7d</entry>
Aug 01 08:15:37 user nova-compute[72426]:       <entry name="uuid">bbb82852-01b7-4609-95a3-f8f36cebbf7d</entry>
Aug 01 08:15:37 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:15:37 user nova-compute[72426]:     </system>
Aug 01 08:15:37 user nova-compute[72426]:   </sysinfo>
Aug 01 08:15:37 user nova-compute[72426]:   <os>
Aug 01 08:15:37 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:15:37 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:15:37 user nova-compute[72426]:   </os>
Aug 01 08:15:37 user nova-compute[72426]:   <features>
Aug 01 08:15:37 user nova-compute[72426]:     <acpi/>
Aug 01 08:15:37 user nova-compute[72426]:     <apic/>
Aug 01 08:15:37 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:15:37 user nova-compute[72426]:   </features>
Aug 01 08:15:37 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:15:37 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:15:37 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:15:37 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:15:37 user nova-compute[72426]:   </clock>
Aug 01 08:15:37 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:15:37 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:15:37 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:15:37 user nova-compute[72426]:   </cpu>
Aug 01 08:15:37 user nova-compute[72426]:   <devices>
Aug 01 08:15:37 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:15:37 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:15:37 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue"/>
Aug 01 08:15:37 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:15:37 user nova-compute[72426]:     </disk>
Aug 01 08:15:37 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:15:37 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:15:37 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk"/>
Aug 01 08:15:37 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:15:37 user nova-compute[72426]:     </disk>
Aug 01 08:15:37 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:15:37 user nova-compute[72426]:       <mac address="fa:16:3e:64:b6:08"/>
Aug 01 08:15:37 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:15:37 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:15:37 user nova-compute[72426]:       <target dev="tapde38d532-38"/>
Aug 01 08:15:37 user nova-compute[72426]:     </interface>
Aug 01 08:15:37 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:15:37 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/console.log" append="off"/>
Aug 01 08:15:37 user nova-compute[72426]:     </serial>
Aug 01 08:15:37 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:15:37 user nova-compute[72426]:     <video>
Aug 01 08:15:37 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:15:37 user nova-compute[72426]:     </video>
Aug 01 08:15:37 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:15:37 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:15:37 user nova-compute[72426]:     </rng>
Aug 01 08:15:37 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:15:37 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:15:37 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:15:37 user nova-compute[72426]:     </memballoon>
Aug 01 08:15:37 user nova-compute[72426]:   </devices>
Aug 01 08:15:37 user nova-compute[72426]: </domain>
Aug 01 08:15:37 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:15:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Instance destroyed successfully.
Aug 01 08:15:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:15:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:15:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No VIF found with MAC fa:16:3e:64:b6:08, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:15:37 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877722.972536, f826ffe7-92dc-4f05-9298-1236513a1af2 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:37 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] VM Stopped (Lifecycle Event)
Aug 01 08:15:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9cb1ecda-b3b3-4f6d-9e26-81f166685c08 None None] [instance: f826ffe7-92dc-4f05-9298-1236513a1af2] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-acf2f41a-08fa-4df2-960a-b705eea6a22c req-30afe357-9c94-4801-8297-0b8453896b47 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acf2f41a-08fa-4df2-960a-b705eea6a22c req-30afe357-9c94-4801-8297-0b8453896b47 service nova] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acf2f41a-08fa-4df2-960a-b705eea6a22c req-30afe357-9c94-4801-8297-0b8453896b47 service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acf2f41a-08fa-4df2-960a-b705eea6a22c req-30afe357-9c94-4801-8297-0b8453896b47 service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-acf2f41a-08fa-4df2-960a-b705eea6a22c req-30afe357-9c94-4801-8297-0b8453896b47 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] No waiting events found dispatching network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:38 user nova-compute[72426]: WARNING nova.compute.manager [req-acf2f41a-08fa-4df2-960a-b705eea6a22c req-30afe357-9c94-4801-8297-0b8453896b47 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received unexpected event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 for instance with vm_state active and task_state rescuing.
Aug 01 08:15:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG os_brick.utils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0359fef6-f39e-4463-a0f4-1be44d67379a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[31546828-9230-4243-a0ab-6fe2192d5b75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e7c1e2-fbdf-4665-aed7-df7c58bc37f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[da90cc0d-0612-459b-aefb-7cbf1484ec34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:15:39 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:15:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9614b5-c963-4d65-81cf-81c623391bc0]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG os_brick.utils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:15:39 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Updating existing volume attachment record: 2823505d-a820-4092-a1db-67b44e113fee {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] No waiting events found dispatching network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:40 user nova-compute[72426]: WARNING nova.compute.manager [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received unexpected event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 for instance with vm_state active and task_state rescuing.
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] No waiting events found dispatching network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:40 user nova-compute[72426]: WARNING nova.compute.manager [req-10089869-ddf8-4624-b043-f9f2436cc0aa req-0409b979-710c-4623-b378-5a621f0a34ad service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received unexpected event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 for instance with vm_state active and task_state rescuing.
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for bbb82852-01b7-4609-95a3-f8f36cebbf7d due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877740.6176434, bbb82852-01b7-4609-95a3-f8f36cebbf7d => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:40 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] VM Resumed (Lifecycle Event)
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-92483b7a-311d-469a-9061-921c42ddb978 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:15:40 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877740.6231477, bbb82852-01b7-4609-95a3-f8f36cebbf7d => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:40 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] VM Started (Lifecycle Event)
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:15:40 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 08:15:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:15:48 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Creating image(s)
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Ensure instance console log exists: /opt/stack/data/nova/instances/551a28bf-12d3-419b-bfb9-6e10647de1ac/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Start _get_guest_xml network_info=[{"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T08:15:27Z,direct_url=<?>,disk_format='qcow2',id=25368259-1a0d-4e01-8fba-32436a460ec8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-224107730',owner='6f71856fa7cb47b998a77b3f4ba436d7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T08:15:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKAGDZMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '551a28bf-12d3-419b-bfb9-6e10647de1ac', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcf0f43a-6502-4277-8b4e-9c5566c6d67c', 'serial': 'dcf0f43a-6502-4277-8b4e-9c5566c6d67c'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '2823505d-a820-4092-a1db-67b44e113fee', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:15:48 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:15:48 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T08:15:27Z,direct_url=<?>,disk_format='qcow2',id=25368259-1a0d-4e01-8fba-32436a460ec8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-224107730',owner='6f71856fa7cb47b998a77b3f4ba436d7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T08:15:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKAGDZMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:15:48 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:15:48 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:15:48 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8869cee-2941-41d0-bc04-5b86a58a8157]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:15:48 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[13246fda-2a67-4da0-9897-70ad8ec67acd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c] added
Aug 01 08:15:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d995c999-c344-4092-a7e5-308be0a8762b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97d34db-0cb4-445c-be4c-3c871630790d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKAGDZMh {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKAGDZMh" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78efbaa-768d-4381-ba54-de7b727ab486]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wKAGDZMh'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8090dbc0-2ccd-46f8-bce6-a8c0e6e56513]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ada22e-de12-4828-87c7-84ad77c0eba4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:15:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:15:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d3c166-2b39-45bf-8eb0-401010ffca2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c, portal: 172.16.0.220,3260]
Aug 01 08:15:48 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c, portal: 172.16.0.220,3260] successful.
Aug 01 08:15:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6120b6c9-83f0-4d7d-8b10-0c465f4108c4]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fea06a2-4492-4896-991c-bf24d1ed3cf2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)
Aug 01 08:15:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:15:48 user nova-compute[72426]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)
Aug 01 08:15:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f570a6a-1656-4aff-a322-70d880af1ecb]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:15:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKAGDZMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26236643430666632', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236643430666632', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-469032252',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-469032252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-469032252',id=21,image_ref='25368259-1a0d-4e01-8fba-32436a460ec8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+YpFAtCQTQQ+qDog31kSoyxSuZtNMBF5YXLisoHGzLTzEoeaSA2f+DmOlN0415wDAULX+hlZXFJeswkxB43oY5VTTsx75Dz+WVDII7Kdku+DTXsWi+0aW79LgaC+hL9Q==',key_name='tempest-keypair-914881832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-waqa73x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-942085866',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:15:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=551a28bf-12d3-419b-bfb9-6e10647de1ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=67f23dc9-1d5d-49d5-af3e-eefebe684941,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f23dc9-1d') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.objects.instance [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lazy-loading 'pci_devices' on Instance uuid 551a28bf-12d3-419b-bfb9-6e10647de1ac {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:15:49 user nova-compute[72426]:   <uuid>551a28bf-12d3-419b-bfb9-6e10647de1ac</uuid>
Aug 01 08:15:49 user nova-compute[72426]:   <name>instance-00000015</name>
Aug 01 08:15:49 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:15:49 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:15:49 user nova-compute[72426]:   <metadata>
Aug 01 08:15:49 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:15:49 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:15:49 user nova-compute[72426]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-469032252</nova:name>
Aug 01 08:15:49 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:15:48</nova:creationTime>
Aug 01 08:15:49 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:15:49 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:15:49 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:15:49 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:15:49 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:15:49 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:15:49 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:15:49 user nova-compute[72426]:       <nova:owner>
Aug 01 08:15:49 user nova-compute[72426]:         <nova:user uuid="49f9ffcf2a8a435a968fd41590d90607">tempest-TestVolumeBootPattern-942085866-project-member</nova:user>
Aug 01 08:15:49 user nova-compute[72426]:         <nova:project uuid="6f71856fa7cb47b998a77b3f4ba436d7">tempest-TestVolumeBootPattern-942085866</nova:project>
Aug 01 08:15:49 user nova-compute[72426]:       </nova:owner>
Aug 01 08:15:49 user nova-compute[72426]:       <nova:root type="image" uuid="25368259-1a0d-4e01-8fba-32436a460ec8"/>
Aug 01 08:15:49 user nova-compute[72426]:       <nova:ports>
Aug 01 08:15:49 user nova-compute[72426]:         <nova:port uuid="67f23dc9-1d5d-49d5-af3e-eefebe684941">
Aug 01 08:15:49 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 08:15:49 user nova-compute[72426]:         </nova:port>
Aug 01 08:15:49 user nova-compute[72426]:       </nova:ports>
Aug 01 08:15:49 user nova-compute[72426]:     </nova:instance>
Aug 01 08:15:49 user nova-compute[72426]:   </metadata>
Aug 01 08:15:49 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:15:49 user nova-compute[72426]:     <system>
Aug 01 08:15:49 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:15:49 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:15:49 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:15:49 user nova-compute[72426]:       <entry name="serial">551a28bf-12d3-419b-bfb9-6e10647de1ac</entry>
Aug 01 08:15:49 user nova-compute[72426]:       <entry name="uuid">551a28bf-12d3-419b-bfb9-6e10647de1ac</entry>
Aug 01 08:15:49 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:15:49 user nova-compute[72426]:     </system>
Aug 01 08:15:49 user nova-compute[72426]:   </sysinfo>
Aug 01 08:15:49 user nova-compute[72426]:   <os>
Aug 01 08:15:49 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:15:49 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:15:49 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:15:49 user nova-compute[72426]:   </os>
Aug 01 08:15:49 user nova-compute[72426]:   <features>
Aug 01 08:15:49 user nova-compute[72426]:     <acpi/>
Aug 01 08:15:49 user nova-compute[72426]:     <apic/>
Aug 01 08:15:49 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:15:49 user nova-compute[72426]:   </features>
Aug 01 08:15:49 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:15:49 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:15:49 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:15:49 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:15:49 user nova-compute[72426]:   </clock>
Aug 01 08:15:49 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:15:49 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:15:49 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:15:49 user nova-compute[72426]:   </cpu>
Aug 01 08:15:49 user nova-compute[72426]:   <devices>
Aug 01 08:15:49 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:15:49 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:15:49 user nova-compute[72426]:       <source dev="/dev/sdc"/>
Aug 01 08:15:49 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:15:49 user nova-compute[72426]:       <serial>dcf0f43a-6502-4277-8b4e-9c5566c6d67c</serial>
Aug 01 08:15:49 user nova-compute[72426]:     </disk>
Aug 01 08:15:49 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:15:49 user nova-compute[72426]:       <mac address="fa:16:3e:d6:4b:33"/>
Aug 01 08:15:49 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:15:49 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:15:49 user nova-compute[72426]:       <target dev="tap67f23dc9-1d"/>
Aug 01 08:15:49 user nova-compute[72426]:     </interface>
Aug 01 08:15:49 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:15:49 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/551a28bf-12d3-419b-bfb9-6e10647de1ac/console.log" append="off"/>
Aug 01 08:15:49 user nova-compute[72426]:     </serial>
Aug 01 08:15:49 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:15:49 user nova-compute[72426]:     <video>
Aug 01 08:15:49 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:15:49 user nova-compute[72426]:     </video>
Aug 01 08:15:49 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:15:49 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:15:49 user nova-compute[72426]:     </rng>
Aug 01 08:15:49 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:15:49 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:15:49 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:15:49 user nova-compute[72426]:     </memballoon>
Aug 01 08:15:49 user nova-compute[72426]:   </devices>
Aug 01 08:15:49 user nova-compute[72426]: </domain>
Aug 01 08:15:49 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-469032252',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-469032252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-469032252',id=21,image_ref='25368259-1a0d-4e01-8fba-32436a460ec8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+YpFAtCQTQQ+qDog31kSoyxSuZtNMBF5YXLisoHGzLTzEoeaSA2f+DmOlN0415wDAULX+hlZXFJeswkxB43oY5VTTsx75Dz+WVDII7Kdku+DTXsWi+0aW79LgaC+hL9Q==',key_name='tempest-keypair-914881832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-waqa73x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-942085866',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:15:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=551a28bf-12d3-419b-bfb9-6e10647de1ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=67f23dc9-1d5d-49d5-af3e-eefebe684941,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f23dc9-1d') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG os_vif [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=67f23dc9-1d5d-49d5-af3e-eefebe684941,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f23dc9-1d') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67f23dc9-1d, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67f23dc9-1d, col_values=(('external_ids', {'iface-id': '67f23dc9-1d5d-49d5-af3e-eefebe684941', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:4b:33', 'vm-uuid': '551a28bf-12d3-419b-bfb9-6e10647de1ac'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:49 user nova-compute[72426]: INFO os_vif [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=67f23dc9-1d5d-49d5-af3e-eefebe684941,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f23dc9-1d')
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:15:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] No VIF found with MAC fa:16:3e:d6:4b:33, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:15:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-dbf3e1b0-51af-46b9-86a3-64ef7b2ad5ab req-06222806-14ac-453e-b96e-716fe9cefde3 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received event network-vif-plugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dbf3e1b0-51af-46b9-86a3-64ef7b2ad5ab req-06222806-14ac-453e-b96e-716fe9cefde3 service nova] Acquiring lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dbf3e1b0-51af-46b9-86a3-64ef7b2ad5ab req-06222806-14ac-453e-b96e-716fe9cefde3 service nova] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dbf3e1b0-51af-46b9-86a3-64ef7b2ad5ab req-06222806-14ac-453e-b96e-716fe9cefde3 service nova] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-dbf3e1b0-51af-46b9-86a3-64ef7b2ad5ab req-06222806-14ac-453e-b96e-716fe9cefde3 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] No waiting events found dispatching network-vif-plugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:51 user nova-compute[72426]: WARNING nova.compute.manager [req-dbf3e1b0-51af-46b9-86a3-64ef7b2ad5ab req-06222806-14ac-453e-b96e-716fe9cefde3 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received unexpected event network-vif-plugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 for instance with vm_state building and task_state spawning.
Aug 01 08:15:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877753.0675032, 551a28bf-12d3-419b-bfb9-6e10647de1ac => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] VM Resumed (Lifecycle Event)
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:15:53 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Instance spawned successfully.
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:15:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877753.0690804, 551a28bf-12d3-419b-bfb9-6e10647de1ac => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:15:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] VM Started (Lifecycle Event)
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:15:53 user nova-compute[72426]: INFO nova.compute.manager [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Took 5.11 seconds to spawn the instance on the hypervisor.
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:15:53 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:15:53 user nova-compute[72426]: INFO nova.compute.manager [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Took 20.07 seconds to build instance.
Aug 01 08:15:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-704e1fb7-6575-4b4d-9ee9-acd7a7ab23b5 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.198s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-0ad72ad1-2efb-4dae-8268-4b07da6829d1 req-6b36ad03-032f-4445-9079-cf3188005787 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received event network-vif-plugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0ad72ad1-2efb-4dae-8268-4b07da6829d1 req-6b36ad03-032f-4445-9079-cf3188005787 service nova] Acquiring lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0ad72ad1-2efb-4dae-8268-4b07da6829d1 req-6b36ad03-032f-4445-9079-cf3188005787 service nova] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0ad72ad1-2efb-4dae-8268-4b07da6829d1 req-6b36ad03-032f-4445-9079-cf3188005787 service nova] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:15:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-0ad72ad1-2efb-4dae-8268-4b07da6829d1 req-6b36ad03-032f-4445-9079-cf3188005787 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] No waiting events found dispatching network-vif-plugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:15:53 user nova-compute[72426]: WARNING nova.compute.manager [req-0ad72ad1-2efb-4dae-8268-4b07da6829d1 req-6b36ad03-032f-4445-9079-cf3188005787 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received unexpected event network-vif-plugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 for instance with vm_state active and task_state None.
Aug 01 08:15:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:15:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-93df8664-a207-4d34-b17a-3dfa9c0f069e req-0f22a10c-b518-4eb5-8d83-f4472c8ab200 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-changed-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-93df8664-a207-4d34-b17a-3dfa9c0f069e req-0f22a10c-b518-4eb5-8d83-f4472c8ab200 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing instance network info cache due to event network-changed-712015d5-a173-4168-a49a-3dba6325ee29. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:16:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-93df8664-a207-4d34-b17a-3dfa9c0f069e req-0f22a10c-b518-4eb5-8d83-f4472c8ab200 service nova] Acquiring lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:16:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-93df8664-a207-4d34-b17a-3dfa9c0f069e req-0f22a10c-b518-4eb5-8d83-f4472c8ab200 service nova] Acquired lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:16:01 user nova-compute[72426]: DEBUG nova.network.neutron [req-93df8664-a207-4d34-b17a-3dfa9c0f069e req-0f22a10c-b518-4eb5-8d83-f4472c8ab200 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Refreshing network info cache for port 712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:16:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:02 user nova-compute[72426]: DEBUG nova.network.neutron [req-93df8664-a207-4d34-b17a-3dfa9c0f069e req-0f22a10c-b518-4eb5-8d83-f4472c8ab200 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updated VIF entry in instance network info cache for port 712015d5-a173-4168-a49a-3dba6325ee29. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:16:02 user nova-compute[72426]: DEBUG nova.network.neutron [req-93df8664-a207-4d34-b17a-3dfa9c0f069e req-0f22a10c-b518-4eb5-8d83-f4472c8ab200 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [{"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-93df8664-a207-4d34-b17a-3dfa9c0f069e req-0f22a10c-b518-4eb5-8d83-f4472c8ab200 service nova] Releasing lock "refresh_cache-b25da8d6-1222-4856-bda1-e0e51c69f26d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:04 user nova-compute[72426]: INFO nova.compute.manager [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Terminating instance
Aug 01 08:16:04 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-f8737f89-6dab-48e4-af74-d087646f5f6d req-81968732-c0d9-4ed2-886d-b9679c297d23 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f8737f89-6dab-48e4-af74-d087646f5f6d req-81968732-c0d9-4ed2-886d-b9679c297d23 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f8737f89-6dab-48e4-af74-d087646f5f6d req-81968732-c0d9-4ed2-886d-b9679c297d23 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f8737f89-6dab-48e4-af74-d087646f5f6d req-81968732-c0d9-4ed2-886d-b9679c297d23 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-f8737f89-6dab-48e4-af74-d087646f5f6d req-81968732-c0d9-4ed2-886d-b9679c297d23 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-unplugged-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-f8737f89-6dab-48e4-af74-d087646f5f6d req-81968732-c0d9-4ed2-886d-b9679c297d23 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-712015d5-a173-4168-a49a-3dba6325ee29 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-c24d43ee-ae94-4574-ab02-6e1351b87328 req-5dc2ad63-83fd-468f-aefd-af06adb456e7 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c24d43ee-ae94-4574-ab02-6e1351b87328 req-5dc2ad63-83fd-468f-aefd-af06adb456e7 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c24d43ee-ae94-4574-ab02-6e1351b87328 req-5dc2ad63-83fd-468f-aefd-af06adb456e7 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c24d43ee-ae94-4574-ab02-6e1351b87328 req-5dc2ad63-83fd-468f-aefd-af06adb456e7 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-c24d43ee-ae94-4574-ab02-6e1351b87328 req-5dc2ad63-83fd-468f-aefd-af06adb456e7 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-unplugged-c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-c24d43ee-ae94-4574-ab02-6e1351b87328 req-5dc2ad63-83fd-468f-aefd-af06adb456e7 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-c68cd240-bcb2-4864-96ed-697b41cfc678 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-9c356b02-35a2-4f01-8de1-b03253e53e37 req-45256473-4448-4c2d-a1b9-b92635f2aa45 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9c356b02-35a2-4f01-8de1-b03253e53e37 req-45256473-4448-4c2d-a1b9-b92635f2aa45 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9c356b02-35a2-4f01-8de1-b03253e53e37 req-45256473-4448-4c2d-a1b9-b92635f2aa45 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9c356b02-35a2-4f01-8de1-b03253e53e37 req-45256473-4448-4c2d-a1b9-b92635f2aa45 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-9c356b02-35a2-4f01-8de1-b03253e53e37 req-45256473-4448-4c2d-a1b9-b92635f2aa45 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-unplugged-78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-9c356b02-35a2-4f01-8de1-b03253e53e37 req-45256473-4448-4c2d-a1b9-b92635f2aa45 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-78781ae1-af5d-477b-a44c-85d53d08c755 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Instance destroyed successfully.
Aug 01 08:16:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lazy-loading 'resources' on Instance uuid b25da8d6-1222-4856-bda1-e0e51c69f26d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=712015d5-a173-4168-a49a-3dba6325ee29,network=Network(d160d631-7152-4cc8-97a7-2dd060e809bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712015d5-a1') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=712015d5-a173-4168-a49a-3dba6325ee29,network=Network(d160d631-7152-4cc8-97a7-2dd060e809bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712015d5-a1') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap712015d5-a1, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: INFO os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:36:7c,bridge_name='br-int',has_traffic_filtering=True,id=712015d5-a173-4168-a49a-3dba6325ee29,network=Network(d160d631-7152-4cc8-97a7-2dd060e809bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap712015d5-a1')
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:14,bridge_name='br-int',has_traffic_filtering=True,id=a6d9f738-9b7c-49bf-8ae2-2bbbd4214036,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6d9f738-9b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:14,bridge_name='br-int',has_traffic_filtering=True,id=a6d9f738-9b7c-49bf-8ae2-2bbbd4214036,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6d9f738-9b') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6d9f738-9b, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: INFO os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:14,bridge_name='br-int',has_traffic_filtering=True,id=a6d9f738-9b7c-49bf-8ae2-2bbbd4214036,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa6d9f738-9b')
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:26:8d,bridge_name='br-int',has_traffic_filtering=True,id=c68cd240-bcb2-4864-96ed-697b41cfc678,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc68cd240-bc') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:26:8d,bridge_name='br-int',has_traffic_filtering=True,id=c68cd240-bcb2-4864-96ed-697b41cfc678,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc68cd240-bc') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc68cd240-bc, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: INFO os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:26:8d,bridge_name='br-int',has_traffic_filtering=True,id=c68cd240-bcb2-4864-96ed-697b41cfc678,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc68cd240-bc')
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f3:79,bridge_name='br-int',has_traffic_filtering=True,id=945a82f8-68fd-49bb-90de-95156e45e7d2,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945a82f8-68') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f3:79,bridge_name='br-int',has_traffic_filtering=True,id=945a82f8-68fd-49bb-90de-95156e45e7d2,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945a82f8-68') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap945a82f8-68, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: INFO os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f3:79,bridge_name='br-int',has_traffic_filtering=True,id=945a82f8-68fd-49bb-90de-95156e45e7d2,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945a82f8-68')
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d8:ef,bridge_name='br-int',has_traffic_filtering=True,id=908eab8b-6159-4a32-85e7-2ee9d9e25899,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eab8b-61') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d8:ef,bridge_name='br-int',has_traffic_filtering=True,id=908eab8b-6159-4a32-85e7-2ee9d9e25899,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eab8b-61') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap908eab8b-61, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: INFO os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d8:ef,bridge_name='br-int',has_traffic_filtering=True,id=908eab8b-6159-4a32-85e7-2ee9d9e25899,network=Network(dc628933-197e-4a2f-8103-4d26a5f9aeaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eab8b-61')
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "address": "fa:16:3e:6a:82:60", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b3a3d4-37", "ovs_interfaceid": "00b3a3d4-37ae-44d5-9279-7327e46a8d4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:82:60,bridge_name='br-int',has_traffic_filtering=True,id=00b3a3d4-37ae-44d5-9279-7327e46a8d4f,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3a3d4-37') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:82:60,bridge_name='br-int',has_traffic_filtering=True,id=00b3a3d4-37ae-44d5-9279-7327e46a8d4f,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3a3d4-37') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00b3a3d4-37, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: INFO os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:82:60,bridge_name='br-int',has_traffic_filtering=True,id=00b3a3d4-37ae-44d5-9279-7327e46a8d4f,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00b3a3d4-37')
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T08:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1171221622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1171221622',id=15,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuZgydrUbQasUPx4jr2/9XGFO7JIxCcgjBZD4q8UD+KEjSpKHXKXLi42e/zU68kVvoHaU4vPjOOxRPiT51Qjo6uG8JSpx7i44tgdmrZxXjChW+A2R1bZyqGE63ja63LPw==',key_name='tempest-keypair-1397682776',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0680c037a2b4e2ca0cc3cc4cada6e11',ramdisk_id='',reservation_id='r-y4pkpokw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-837970744',owner_user_name='tempest-TaggedBootDevicesTest_v242-837970744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcec51a00543416aa0f5f4b566d1e23e',uuid=b25da8d6-1222-4856-bda1-e0e51c69f26d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converting VIF {"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9e:6e,bridge_name='br-int',has_traffic_filtering=True,id=78781ae1-af5d-477b-a44c-85d53d08c755,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78781ae1-af') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9e:6e,bridge_name='br-int',has_traffic_filtering=True,id=78781ae1-af5d-477b-a44c-85d53d08c755,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78781ae1-af') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78781ae1-af, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:16:06 user nova-compute[72426]: INFO os_vif [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:9e:6e,bridge_name='br-int',has_traffic_filtering=True,id=78781ae1-af5d-477b-a44c-85d53d08c755,network=Network(5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78781ae1-af')
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSdQjkJs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:16:06 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[480c12c0-1bcb-4a9f-8c17-894b05637e18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00caaf9-f33b-4ea8-8849-c6c6ad151183]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38e6dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049'): ({'sdf'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Removing single pathed devices sdf {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[369144d6-610b-4af0-84ea-ad620bb898cd]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5d21aa-d5f4-4d91-90f7-83e6a62fbf00]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Flushing IO for device /dev/sdf {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5704c1e-3442-4e68-a065-1e559d57d823]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d1778-68f9-476d-af8a-a5dafe48ba89]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59ba1a3-6c8b-4920-af14-eb332d9e1b55]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[09afcbf9-de9a-49ea-91af-6cbdbddfe744]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049, portal: 172.16.0.220,3260]
Aug 01 08:16:06 user nova-compute[72426]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049, portal: 172.16.0.220,3260] successful.
Aug 01 08:16:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:06 user nova-compute[72426]: WARNING nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-712015d5-a173-4168-a49a-3dba6325ee29 for instance with vm_state active and task_state deleting.
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-unplugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:06 user nova-compute[72426]: WARNING nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-a6d9f738-9b7c-49bf-8ae2-2bbbd4214036 for instance with vm_state active and task_state deleting.
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-unplugged-945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-9e9b40a4-93b4-4011-b302-99f999bce5e7 req-e0dca99d-c406-454a-9427-eafbb3ad24f2 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-945a82f8-68fd-49bb-90de-95156e45e7d2 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89fb433-18d0-42d0-a5d1-fd2e9f9a4049 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50adf5b-ba76-4c02-805e-7f52dd81d3d5]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] <== disconnect_volume: return (377ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QfEVqZCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:16:06 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e733e2-98cf-40c0-8336-722989c1c118]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c538e9d0-873e-47bc-bd2a-c31574657876]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:16:06 user nova-compute[72426]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)
Aug 01 08:16:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c54e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773'): ({'sdh'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Removing single pathed devices sdh {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5aba78-3fc7-477c-93c1-b0a706812829]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee82fa60-cf59-45fd-a236-461a8c96afd6]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Flushing IO for device /dev/sdh {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8da4f1-9610-43f3-808d-7bd5df9356e0]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-c68cd240-bcb2-4864-96ed-697b41cfc678 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:06 user nova-compute[72426]: WARNING nova.compute.manager [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-c68cd240-bcb2-4864-96ed-697b41cfc678 for instance with vm_state active and task_state deleting.
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-unplugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:06 user nova-compute[72426]: WARNING nova.compute.manager [req-3192007f-e79d-4222-a5c2-2c6f9354004d req-7d54274d-1f7c-4b67-b900-bb2fce1659fe service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-908eab8b-6159-4a32-85e7-2ee9d9e25899 for instance with vm_state active and task_state deleting.
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c083010-43c2-4ce3-98ed-50b25c0476c0]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] SCSI volumes sdh have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b287e84a-ee6c-4db0-bb17-0bce3b2b28ce]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:16:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f15afb-e301-4077-984d-23bbd53920fa]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773, portal: 172.16.0.220,3260]
Aug 01 08:16:07 user nova-compute[72426]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773, portal: 172.16.0.220,3260] successful.
Aug 01 08:16:07 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45a7812-1631-41c8-bc9b-9e51e1a94773 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a19fbf9-5cb4-4f47-91f9-c5c60c41a348]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] <== disconnect_volume: return (357ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDKBtrOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:16:07 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1561173c-abc1-478e-82ed-16587fcac030]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9042cbc-027b-4167-8169-d3a69adfd1af]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:16:07 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:16:07 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:16:07 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:16:07 user nova-compute[72426]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)
Aug 01 08:16:07 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:16:07 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:16:07 user nova-compute[72426]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c (non-flash)
Aug 01 08:16:07 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:16:07 user nova-compute[72426]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)
Aug 01 08:16:07 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c54e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c'): ({'sdi'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Removing single pathed devices sdi {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0102be4-77b6-48ec-89b8-04b17b68a47b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[66999c7c-7bd4-414b-bfff-41071494c859]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Flushing IO for device /dev/sdi {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6b4ed-f6ed-4d08-9906-e57a3c98c54e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.050s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaee301-5fdc-417f-b58f-c3132bee4966]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] SCSI volumes sdi have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5651de81-6468-4e35-871d-a2778bc1915e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abf23a5-bec5-44d8-9ea6-4dbf917e97c7]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c, portal: 172.16.0.220,3260]
Aug 01 08:16:07 user nova-compute[72426]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c, portal: 172.16.0.220,3260] successful.
Aug 01 08:16:07 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29e6bc04-cc7d-4d25-a11a-476d1c180c0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d8a653-d53b-497e-8834-e9dd9695b9fc]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] <== disconnect_volume: return (343ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:16:07 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Deleting instance files /opt/stack/data/nova/instances/b25da8d6-1222-4856-bda1-e0e51c69f26d_del
Aug 01 08:16:07 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Deletion of /opt/stack/data/nova/instances/b25da8d6-1222-4856-bda1-e0e51c69f26d_del complete
Aug 01 08:16:07 user nova-compute[72426]: INFO nova.compute.manager [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Took 3.37 seconds to destroy the instance on the hypervisor.
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-ff89a7a3-31a2-493c-8b25-45a6f82257db req-44c0eb9c-a0d0-45e3-bc06-505c5c9b9260 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ff89a7a3-31a2-493c-8b25-45a6f82257db req-44c0eb9c-a0d0-45e3-bc06-505c5c9b9260 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ff89a7a3-31a2-493c-8b25-45a6f82257db req-44c0eb9c-a0d0-45e3-bc06-505c5c9b9260 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ff89a7a3-31a2-493c-8b25-45a6f82257db req-44c0eb9c-a0d0-45e3-bc06-505c5c9b9260 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-ff89a7a3-31a2-493c-8b25-45a6f82257db req-44c0eb9c-a0d0-45e3-bc06-505c5c9b9260 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:07 user nova-compute[72426]: WARNING nova.compute.manager [req-ff89a7a3-31a2-493c-8b25-45a6f82257db req-44c0eb9c-a0d0-45e3-bc06-505c5c9b9260 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-78781ae1-af5d-477b-a44c-85d53d08c755 for instance with vm_state active and task_state deleting.
Aug 01 08:16:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:08 user nova-compute[72426]: WARNING nova.compute.manager [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-945a82f8-68fd-49bb-90de-95156e45e7d2 for instance with vm_state active and task_state deleting.
Aug 01 08:16:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-unplugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-unplugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-plugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] Acquiring lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] No waiting events found dispatching network-vif-plugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:08 user nova-compute[72426]: WARNING nova.compute.manager [req-acb75f0d-af3b-4e36-8715-e282b9ab2837 req-53cad606-4827-4bb4-9a77-241a390c4779 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received unexpected event network-vif-plugged-00b3a3d4-37ae-44d5-9279-7327e46a8d4f for instance with vm_state active and task_state deleting.
Aug 01 08:16:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-3da58c75-9918-42ae-9658-3dcdbce27875 req-9620e92c-bd2a-453a-a2ea-f0f485a90a67 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-deleted-00b3a3d4-37ae-44d5-9279-7327e46a8d4f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:09 user nova-compute[72426]: INFO nova.compute.manager [req-3da58c75-9918-42ae-9658-3dcdbce27875 req-9620e92c-bd2a-453a-a2ea-f0f485a90a67 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Neutron deleted interface 00b3a3d4-37ae-44d5-9279-7327e46a8d4f; detaching it from the instance and deleting it from the info cache
Aug 01 08:16:09 user nova-compute[72426]: DEBUG nova.network.neutron [req-3da58c75-9918-42ae-9658-3dcdbce27875 req-9620e92c-bd2a-453a-a2ea-f0f485a90a67 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [{"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78781ae1-af5d-477b-a44c-85d53d08c755", "address": "fa:16:3e:6f:9e:6e", "network": {"id": "5a6bebc4-6f8a-41d6-88ba-bbe45143bbc5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1368906223", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78781ae1-af", "ovs_interfaceid": "78781ae1-af5d-477b-a44c-85d53d08c755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-3da58c75-9918-42ae-9658-3dcdbce27875 req-9620e92c-bd2a-453a-a2ea-f0f485a90a67 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Detach interface failed, port_id=00b3a3d4-37ae-44d5-9279-7327e46a8d4f, reason: Instance b25da8d6-1222-4856-bda1-e0e51c69f26d could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:16:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-deleted-78781ae1-af5d-477b-a44c-85d53d08c755 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:12 user nova-compute[72426]: INFO nova.compute.manager [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Neutron deleted interface 78781ae1-af5d-477b-a44c-85d53d08c755; detaching it from the instance and deleting it from the info cache
Aug 01 08:16:12 user nova-compute[72426]: DEBUG nova.network.neutron [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [{"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "address": "fa:16:3e:0d:d8:ef", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eab8b-61", "ovs_interfaceid": "908eab8b-6159-4a32-85e7-2ee9d9e25899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Detach interface failed, port_id=78781ae1-af5d-477b-a44c-85d53d08c755, reason: Instance b25da8d6-1222-4856-bda1-e0e51c69f26d could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:16:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-deleted-908eab8b-6159-4a32-85e7-2ee9d9e25899 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:12 user nova-compute[72426]: INFO nova.compute.manager [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Neutron deleted interface 908eab8b-6159-4a32-85e7-2ee9d9e25899; detaching it from the instance and deleting it from the info cache
Aug 01 08:16:12 user nova-compute[72426]: DEBUG nova.network.neutron [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [{"id": "712015d5-a173-4168-a49a-3dba6325ee29", "address": "fa:16:3e:ef:36:7c", "network": {"id": "d160d631-7152-4cc8-97a7-2dd060e809bf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2049045770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap712015d5-a1", "ovs_interfaceid": "712015d5-a173-4168-a49a-3dba6325ee29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Detach interface failed, port_id=908eab8b-6159-4a32-85e7-2ee9d9e25899, reason: Instance b25da8d6-1222-4856-bda1-e0e51c69f26d could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:16:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-deleted-712015d5-a173-4168-a49a-3dba6325ee29 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:12 user nova-compute[72426]: INFO nova.compute.manager [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Neutron deleted interface 712015d5-a173-4168-a49a-3dba6325ee29; detaching it from the instance and deleting it from the info cache
Aug 01 08:16:12 user nova-compute[72426]: DEBUG nova.network.neutron [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [{"id": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "address": "fa:16:3e:74:c3:14", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d9f738-9b", "ovs_interfaceid": "a6d9f738-9b7c-49bf-8ae2-2bbbd4214036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c68cd240-bcb2-4864-96ed-697b41cfc678", "address": "fa:16:3e:90:26:8d", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68cd240-bc", "ovs_interfaceid": "c68cd240-bcb2-4864-96ed-697b41cfc678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "945a82f8-68fd-49bb-90de-95156e45e7d2", "address": "fa:16:3e:5e:f3:79", "network": {"id": "dc628933-197e-4a2f-8103-4d26a5f9aeaf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1106243297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e0680c037a2b4e2ca0cc3cc4cada6e11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945a82f8-68", "ovs_interfaceid": "945a82f8-68fd-49bb-90de-95156e45e7d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:12 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-0eeeeae9-970f-4016-8fd3-9c17e1658719 req-aa02cc19-2560-4772-86ee-ab2077a8bd93 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Detach interface failed, port_id=712015d5-a173-4168-a49a-3dba6325ee29, reason: Instance b25da8d6-1222-4856-bda1-e0e51c69f26d could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:16:12 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Took 4.59 seconds to deallocate network for instance.
Aug 01 08:16:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-c3cd086a-78d3-4206-9ea2-8dca70b44a4c req-6a09f1fb-80ca-4117-a742-63d556acd6f8 service nova] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Received event network-vif-deleted-945a82f8-68fd-49bb-90de-95156e45e7d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:20 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877765.9191139, b25da8d6-1222-4856-bda1-e0e51c69f26d => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:16:20 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] VM Stopped (Lifecycle Event)
Aug 01 08:16:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8bb50aca-78a8-45bf-ac54-91c838e45b6e None None] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:16:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:22 user nova-compute[72426]: INFO nova.compute.manager [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] [instance: b25da8d6-1222-4856-bda1-e0e51c69f26d] Took 10.53 seconds to detach 3 volumes for instance.
Aug 01 08:16:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:23 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:16:23 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:16:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:23 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Deleted allocations for instance b25da8d6-1222-4856-bda1-e0e51c69f26d
Aug 01 08:16:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3ee64e26-e910-457d-b0f1-9ad6f4e4a349 tempest-TaggedBootDevicesTest_v242-837970744 tempest-TaggedBootDevicesTest_v242-837970744-project-member] Lock "b25da8d6-1222-4856-bda1-e0e51c69f26d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.190s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:23 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:16:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:16:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:16:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:27 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:16:27 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7302MB free_disk=25.681354522705078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.manager [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2236c44a-562a-4b67-a487-ad51180dbaa0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0debd99f-9724-42ed-8048-857edce10e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 551a28bf-12d3-419b-bfb9-6e10647de1ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.330s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:16:27 user nova-compute[72426]: INFO nova.compute.claims [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Claim successful on node user
Aug 01 08:16:28 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG nova.network.neutron [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:16:28 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:16:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG nova.policy [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c3b164242dc4336889758526ddabd74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be045e22d244d6984b171cd0345b6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:16:28 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Creating image(s)
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "/opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "/opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "/opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.158s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk 1073741824" returned: 0 in 0.055s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Cannot resize image /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG nova.objects.instance [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'migration_context' on Instance uuid 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Ensure instance console log exists: /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:29 user nova-compute[72426]: DEBUG nova.network.neutron [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Successfully created port: b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Successfully updated port: b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "refresh_cache-0acb6dc3-765c-44fb-a06b-a30e5e6948f3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquired lock "refresh_cache-0acb6dc3-765c-44fb-a06b-a30e5e6948f3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.compute.manager [req-1e0742a6-b8a8-4c58-bb3d-c4034f7e0f2a req-2f25474b-fed1-40b9-bafa-173b36358e8f service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received event network-changed-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.compute.manager [req-1e0742a6-b8a8-4c58-bb3d-c4034f7e0f2a req-2f25474b-fed1-40b9-bafa-173b36358e8f service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Refreshing instance network info cache due to event network-changed-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1e0742a6-b8a8-4c58-bb3d-c4034f7e0f2a req-2f25474b-fed1-40b9-bafa-173b36358e8f service nova] Acquiring lock "refresh_cache-0acb6dc3-765c-44fb-a06b-a30e5e6948f3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Updating instance_info_cache with network_info: [{"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Releasing lock "refresh_cache-0acb6dc3-765c-44fb-a06b-a30e5e6948f3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.compute.manager [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Instance network_info: |[{"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1e0742a6-b8a8-4c58-bb3d-c4034f7e0f2a req-2f25474b-fed1-40b9-bafa-173b36358e8f service nova] Acquired lock "refresh_cache-0acb6dc3-765c-44fb-a06b-a30e5e6948f3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.network.neutron [req-1e0742a6-b8a8-4c58-bb3d-c4034f7e0f2a req-2f25474b-fed1-40b9-bafa-173b36358e8f service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Refreshing network info cache for port b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Start _get_guest_xml network_info=[{"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:16:30 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:16:30 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-933736993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-933736993',id=22,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfy+Ue7iG7BvSUL0cdNNUG7/aOrlzMgtbOEm1baGkMuO6M8gkHjWLdy2yw5wsFNexYuXyX62S/LEVFLxRQa3A5fXcFHAmWfacJZZkUz6ZjKu0OZTMQw7Q8mFvY1wezXPQ==',key_name='tempest-keypair-375552062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7be045e22d244d6984b171cd0345b6ec',ramdisk_id='',reservation_id='r-mz14ui4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-328470853',owner_user_name='tempest-ServerActionsV293TestJSON-328470853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3b164242dc4336889758526ddabd74',uuid=0acb6dc3-765c-44fb-a06b-a30e5e6948f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converting VIF {"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:45:2f,bridge_name='br-int',has_traffic_filtering=True,id=b1bf14a4-3514-48fd-84f4-fdd78ebc5df1,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bf14a4-35') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.objects.instance [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'pci_devices' on Instance uuid 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:16:30 user nova-compute[72426]:   <uuid>0acb6dc3-765c-44fb-a06b-a30e5e6948f3</uuid>
Aug 01 08:16:30 user nova-compute[72426]:   <name>instance-00000016</name>
Aug 01 08:16:30 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:16:30 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:16:30 user nova-compute[72426]:   <metadata>
Aug 01 08:16:30 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:16:30 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:16:30 user nova-compute[72426]:       <nova:name>tempest-ServerActionsV293TestJSON-server-933736993</nova:name>
Aug 01 08:16:30 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:16:30</nova:creationTime>
Aug 01 08:16:30 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:16:30 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:16:30 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:16:30 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:16:30 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:16:30 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:16:30 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:16:30 user nova-compute[72426]:       <nova:owner>
Aug 01 08:16:30 user nova-compute[72426]:         <nova:user uuid="0c3b164242dc4336889758526ddabd74">tempest-ServerActionsV293TestJSON-328470853-project-member</nova:user>
Aug 01 08:16:30 user nova-compute[72426]:         <nova:project uuid="7be045e22d244d6984b171cd0345b6ec">tempest-ServerActionsV293TestJSON-328470853</nova:project>
Aug 01 08:16:30 user nova-compute[72426]:       </nova:owner>
Aug 01 08:16:30 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:16:30 user nova-compute[72426]:       <nova:ports>
Aug 01 08:16:30 user nova-compute[72426]:         <nova:port uuid="b1bf14a4-3514-48fd-84f4-fdd78ebc5df1">
Aug 01 08:16:30 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 08:16:30 user nova-compute[72426]:         </nova:port>
Aug 01 08:16:30 user nova-compute[72426]:       </nova:ports>
Aug 01 08:16:30 user nova-compute[72426]:     </nova:instance>
Aug 01 08:16:30 user nova-compute[72426]:   </metadata>
Aug 01 08:16:30 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:16:30 user nova-compute[72426]:     <system>
Aug 01 08:16:30 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:16:30 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:16:30 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:16:30 user nova-compute[72426]:       <entry name="serial">0acb6dc3-765c-44fb-a06b-a30e5e6948f3</entry>
Aug 01 08:16:30 user nova-compute[72426]:       <entry name="uuid">0acb6dc3-765c-44fb-a06b-a30e5e6948f3</entry>
Aug 01 08:16:30 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:16:30 user nova-compute[72426]:     </system>
Aug 01 08:16:30 user nova-compute[72426]:   </sysinfo>
Aug 01 08:16:30 user nova-compute[72426]:   <os>
Aug 01 08:16:30 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:16:30 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:16:30 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:16:30 user nova-compute[72426]:   </os>
Aug 01 08:16:30 user nova-compute[72426]:   <features>
Aug 01 08:16:30 user nova-compute[72426]:     <acpi/>
Aug 01 08:16:30 user nova-compute[72426]:     <apic/>
Aug 01 08:16:30 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:16:30 user nova-compute[72426]:   </features>
Aug 01 08:16:30 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:16:30 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:16:30 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:16:30 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:16:30 user nova-compute[72426]:   </clock>
Aug 01 08:16:30 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:16:30 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:16:30 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:16:30 user nova-compute[72426]:   </cpu>
Aug 01 08:16:30 user nova-compute[72426]:   <devices>
Aug 01 08:16:30 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:16:30 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:16:30 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk"/>
Aug 01 08:16:30 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:16:30 user nova-compute[72426]:     </disk>
Aug 01 08:16:30 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:16:30 user nova-compute[72426]:       <mac address="fa:16:3e:8b:45:2f"/>
Aug 01 08:16:30 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:16:30 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:16:30 user nova-compute[72426]:       <target dev="tapb1bf14a4-35"/>
Aug 01 08:16:30 user nova-compute[72426]:     </interface>
Aug 01 08:16:30 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:16:30 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/console.log" append="off"/>
Aug 01 08:16:30 user nova-compute[72426]:     </serial>
Aug 01 08:16:30 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:16:30 user nova-compute[72426]:     <video>
Aug 01 08:16:30 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:16:30 user nova-compute[72426]:     </video>
Aug 01 08:16:30 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:16:30 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:16:30 user nova-compute[72426]:     </rng>
Aug 01 08:16:30 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:16:30 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:16:30 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:16:30 user nova-compute[72426]:     </memballoon>
Aug 01 08:16:30 user nova-compute[72426]:   </devices>
Aug 01 08:16:30 user nova-compute[72426]: </domain>
Aug 01 08:16:30 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-933736993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-933736993',id=22,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfy+Ue7iG7BvSUL0cdNNUG7/aOrlzMgtbOEm1baGkMuO6M8gkHjWLdy2yw5wsFNexYuXyX62S/LEVFLxRQa3A5fXcFHAmWfacJZZkUz6ZjKu0OZTMQw7Q8mFvY1wezXPQ==',key_name='tempest-keypair-375552062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7be045e22d244d6984b171cd0345b6ec',ramdisk_id='',reservation_id='r-mz14ui4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-328470853',owner_user_name='tempest-ServerActionsV293TestJSON-328470853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3b164242dc4336889758526ddabd74',uuid=0acb6dc3-765c-44fb-a06b-a30e5e6948f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converting VIF {"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:45:2f,bridge_name='br-int',has_traffic_filtering=True,id=b1bf14a4-3514-48fd-84f4-fdd78ebc5df1,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bf14a4-35') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG os_vif [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:45:2f,bridge_name='br-int',has_traffic_filtering=True,id=b1bf14a4-3514-48fd-84f4-fdd78ebc5df1,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bf14a4-35') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1bf14a4-35, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1bf14a4-35, col_values=(('external_ids', {'iface-id': 'b1bf14a4-3514-48fd-84f4-fdd78ebc5df1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:45:2f', 'vm-uuid': '0acb6dc3-765c-44fb-a06b-a30e5e6948f3'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:30 user nova-compute[72426]: INFO os_vif [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:45:2f,bridge_name='br-int',has_traffic_filtering=True,id=b1bf14a4-3514-48fd-84f4-fdd78ebc5df1,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bf14a4-35')
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:16:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] No VIF found with MAC fa:16:3e:8b:45:2f, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG nova.network.neutron [req-1e0742a6-b8a8-4c58-bb3d-c4034f7e0f2a req-2f25474b-fed1-40b9-bafa-173b36358e8f service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Updated VIF entry in instance network info cache for port b1bf14a4-3514-48fd-84f4-fdd78ebc5df1. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG nova.network.neutron [req-1e0742a6-b8a8-4c58-bb3d-c4034f7e0f2a req-2f25474b-fed1-40b9-bafa-173b36358e8f service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Updating instance_info_cache with network_info: [{"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1e0742a6-b8a8-4c58-bb3d-c4034f7e0f2a req-2f25474b-fed1-40b9-bafa-173b36358e8f service nova] Releasing lock "refresh_cache-0acb6dc3-765c-44fb-a06b-a30e5e6948f3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Skipping network cache update for instance because it is Building. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:16:31 user nova-compute[72426]: DEBUG nova.objects.instance [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lazy-loading 'info_cache' on Instance uuid c10d6140-aa17-4342-9135-d07a73285483 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updating instance_info_cache with network_info: [{"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-375486a9-0a33-4f45-ae77-e28129f11173 req-d423f1dd-9aaf-4c87-91c1-f97044d09e91 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received event network-vif-plugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-375486a9-0a33-4f45-ae77-e28129f11173 req-d423f1dd-9aaf-4c87-91c1-f97044d09e91 service nova] Acquiring lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-375486a9-0a33-4f45-ae77-e28129f11173 req-d423f1dd-9aaf-4c87-91c1-f97044d09e91 service nova] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-375486a9-0a33-4f45-ae77-e28129f11173 req-d423f1dd-9aaf-4c87-91c1-f97044d09e91 service nova] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-375486a9-0a33-4f45-ae77-e28129f11173 req-d423f1dd-9aaf-4c87-91c1-f97044d09e91 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] No waiting events found dispatching network-vif-plugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:32 user nova-compute[72426]: WARNING nova.compute.manager [req-375486a9-0a33-4f45-ae77-e28129f11173 req-d423f1dd-9aaf-4c87-91c1-f97044d09e91 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received unexpected event network-vif-plugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 for instance with vm_state building and task_state spawning.
Aug 01 08:16:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877794.4009433, 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:16:34 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] VM Resumed (Lifecycle Event)
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:16:34 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Instance spawned successfully.
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:34 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877794.4043853, 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:16:34 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] VM Started (Lifecycle Event)
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:16:34 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:16:34 user nova-compute[72426]: INFO nova.compute.manager [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:16:34 user nova-compute[72426]: INFO nova.compute.manager [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Took 7.14 seconds to build instance.
Aug 01 08:16:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-936ea30a-3edd-4418-8048-25ec8606072e tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.277s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-d72af42b-270e-4ba4-b17c-741899d25fb4 req-836a9245-992c-4930-b3dc-f42cc97e6cca service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received event network-vif-plugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d72af42b-270e-4ba4-b17c-741899d25fb4 req-836a9245-992c-4930-b3dc-f42cc97e6cca service nova] Acquiring lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d72af42b-270e-4ba4-b17c-741899d25fb4 req-836a9245-992c-4930-b3dc-f42cc97e6cca service nova] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d72af42b-270e-4ba4-b17c-741899d25fb4 req-836a9245-992c-4930-b3dc-f42cc97e6cca service nova] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-d72af42b-270e-4ba4-b17c-741899d25fb4 req-836a9245-992c-4930-b3dc-f42cc97e6cca service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] No waiting events found dispatching network-vif-plugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:34 user nova-compute[72426]: WARNING nova.compute.manager [req-d72af42b-270e-4ba4-b17c-741899d25fb4 req-836a9245-992c-4930-b3dc-f42cc97e6cca service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received unexpected event network-vif-plugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 for instance with vm_state active and task_state None.
Aug 01 08:16:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:16:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:16:45 user nova-compute[72426]: INFO nova.compute.claims [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Claim successful on node user
Aug 01 08:16:46 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:16:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:16:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG nova.policy [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f32fed5c40f24c2086d59cbb61f93bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4cff1bbd5247afa9ed2ddf4db11738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:16:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Creating image(s)
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "/opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "/opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.168s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk 1073741824" returned: 0 in 0.058s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Successfully created port: 32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Cannot resize image /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG nova.objects.instance [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'migration_context' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Ensure instance console log exists: /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Successfully updated port: 32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquired lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-de42bfde-4cbc-48ab-a0ac-081705180d23 req-59a385ea-61f0-4a4e-9126-8805c58ad63b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-changed-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-de42bfde-4cbc-48ab-a0ac-081705180d23 req-59a385ea-61f0-4a4e-9126-8805c58ad63b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Refreshing instance network info cache due to event network-changed-32122388-a2bc-410d-91f7-594b4702c6a0. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-de42bfde-4cbc-48ab-a0ac-081705180d23 req-59a385ea-61f0-4a4e-9126-8805c58ad63b service nova] Acquiring lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updating instance_info_cache with network_info: [{"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Releasing lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Instance network_info: |[{"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-de42bfde-4cbc-48ab-a0ac-081705180d23 req-59a385ea-61f0-4a4e-9126-8805c58ad63b service nova] Acquired lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.network.neutron [req-de42bfde-4cbc-48ab-a0ac-081705180d23 req-59a385ea-61f0-4a4e-9126-8805c58ad63b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Refreshing network info cache for port 32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Start _get_guest_xml network_info=[{"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:16:48 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:16:48 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-120743636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-120743636',id=23,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmbPf8dfpbOw3AdFtYviiNgMHzZe3NiBwdcr4xPSbxyQfYaP4IAPXsp+HNXQ2y8gncIZv7OS8P7105AkmU3pmjBBpBNxkZJUuHPFEmhtLWG2TELfES9J3p65QCfv2L7SQ==',key_name='tempest-keypair-1007772321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-kmty00m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=a5e525d1-9cbd-4e92-8eea-f256b6edd86e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.objects.instance [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'pci_devices' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:16:48 user nova-compute[72426]:   <uuid>a5e525d1-9cbd-4e92-8eea-f256b6edd86e</uuid>
Aug 01 08:16:48 user nova-compute[72426]:   <name>instance-00000017</name>
Aug 01 08:16:48 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:16:48 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:16:48 user nova-compute[72426]:   <metadata>
Aug 01 08:16:48 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:16:48 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:16:48 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-120743636</nova:name>
Aug 01 08:16:48 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:16:48</nova:creationTime>
Aug 01 08:16:48 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:16:48 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:16:48 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:16:48 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:16:48 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:16:48 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:16:48 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:16:48 user nova-compute[72426]:       <nova:owner>
Aug 01 08:16:48 user nova-compute[72426]:         <nova:user uuid="f32fed5c40f24c2086d59cbb61f93bea">tempest-AttachVolumeShelveTestJSON-1854691353-project-member</nova:user>
Aug 01 08:16:48 user nova-compute[72426]:         <nova:project uuid="9a4cff1bbd5247afa9ed2ddf4db11738">tempest-AttachVolumeShelveTestJSON-1854691353</nova:project>
Aug 01 08:16:48 user nova-compute[72426]:       </nova:owner>
Aug 01 08:16:48 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:16:48 user nova-compute[72426]:       <nova:ports>
Aug 01 08:16:48 user nova-compute[72426]:         <nova:port uuid="32122388-a2bc-410d-91f7-594b4702c6a0">
Aug 01 08:16:48 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 08:16:48 user nova-compute[72426]:         </nova:port>
Aug 01 08:16:48 user nova-compute[72426]:       </nova:ports>
Aug 01 08:16:48 user nova-compute[72426]:     </nova:instance>
Aug 01 08:16:48 user nova-compute[72426]:   </metadata>
Aug 01 08:16:48 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:16:48 user nova-compute[72426]:     <system>
Aug 01 08:16:48 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:16:48 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:16:48 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:16:48 user nova-compute[72426]:       <entry name="serial">a5e525d1-9cbd-4e92-8eea-f256b6edd86e</entry>
Aug 01 08:16:48 user nova-compute[72426]:       <entry name="uuid">a5e525d1-9cbd-4e92-8eea-f256b6edd86e</entry>
Aug 01 08:16:48 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:16:48 user nova-compute[72426]:     </system>
Aug 01 08:16:48 user nova-compute[72426]:   </sysinfo>
Aug 01 08:16:48 user nova-compute[72426]:   <os>
Aug 01 08:16:48 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:16:48 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:16:48 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:16:48 user nova-compute[72426]:   </os>
Aug 01 08:16:48 user nova-compute[72426]:   <features>
Aug 01 08:16:48 user nova-compute[72426]:     <acpi/>
Aug 01 08:16:48 user nova-compute[72426]:     <apic/>
Aug 01 08:16:48 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:16:48 user nova-compute[72426]:   </features>
Aug 01 08:16:48 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:16:48 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:16:48 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:16:48 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:16:48 user nova-compute[72426]:   </clock>
Aug 01 08:16:48 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:16:48 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:16:48 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:16:48 user nova-compute[72426]:   </cpu>
Aug 01 08:16:48 user nova-compute[72426]:   <devices>
Aug 01 08:16:48 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:16:48 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:16:48 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk"/>
Aug 01 08:16:48 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:16:48 user nova-compute[72426]:     </disk>
Aug 01 08:16:48 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:16:48 user nova-compute[72426]:       <mac address="fa:16:3e:a7:2e:e2"/>
Aug 01 08:16:48 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:16:48 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:16:48 user nova-compute[72426]:       <target dev="tap32122388-a2"/>
Aug 01 08:16:48 user nova-compute[72426]:     </interface>
Aug 01 08:16:48 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:16:48 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/console.log" append="off"/>
Aug 01 08:16:48 user nova-compute[72426]:     </serial>
Aug 01 08:16:48 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:16:48 user nova-compute[72426]:     <video>
Aug 01 08:16:48 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:16:48 user nova-compute[72426]:     </video>
Aug 01 08:16:48 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:16:48 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:16:48 user nova-compute[72426]:     </rng>
Aug 01 08:16:48 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:16:48 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:16:48 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:16:48 user nova-compute[72426]:     </memballoon>
Aug 01 08:16:48 user nova-compute[72426]:   </devices>
Aug 01 08:16:48 user nova-compute[72426]: </domain>
Aug 01 08:16:48 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-120743636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-120743636',id=23,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmbPf8dfpbOw3AdFtYviiNgMHzZe3NiBwdcr4xPSbxyQfYaP4IAPXsp+HNXQ2y8gncIZv7OS8P7105AkmU3pmjBBpBNxkZJUuHPFEmhtLWG2TELfES9J3p65QCfv2L7SQ==',key_name='tempest-keypair-1007772321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-kmty00m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=a5e525d1-9cbd-4e92-8eea-f256b6edd86e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG os_vif [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32122388-a2, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32122388-a2, col_values=(('external_ids', {'iface-id': '32122388-a2bc-410d-91f7-594b4702c6a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:2e:e2', 'vm-uuid': 'a5e525d1-9cbd-4e92-8eea-f256b6edd86e'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:48 user nova-compute[72426]: INFO os_vif [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2')
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:16:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] No VIF found with MAC fa:16:3e:a7:2e:e2, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:16:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-de42bfde-4cbc-48ab-a0ac-081705180d23 req-59a385ea-61f0-4a4e-9126-8805c58ad63b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updated VIF entry in instance network info cache for port 32122388-a2bc-410d-91f7-594b4702c6a0. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:16:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-de42bfde-4cbc-48ab-a0ac-081705180d23 req-59a385ea-61f0-4a4e-9126-8805c58ad63b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updating instance_info_cache with network_info: [{"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-de42bfde-4cbc-48ab-a0ac-081705180d23 req-59a385ea-61f0-4a4e-9126-8805c58ad63b service nova] Releasing lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:16:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-cc8ab56d-57e3-400d-b45c-36f617f57ce5 req-411aeca2-53eb-4072-a534-7b74faea8a5d service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cc8ab56d-57e3-400d-b45c-36f617f57ce5 req-411aeca2-53eb-4072-a534-7b74faea8a5d service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cc8ab56d-57e3-400d-b45c-36f617f57ce5 req-411aeca2-53eb-4072-a534-7b74faea8a5d service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cc8ab56d-57e3-400d-b45c-36f617f57ce5 req-411aeca2-53eb-4072-a534-7b74faea8a5d service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-cc8ab56d-57e3-400d-b45c-36f617f57ce5 req-411aeca2-53eb-4072-a534-7b74faea8a5d service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:50 user nova-compute[72426]: WARNING nova.compute.manager [req-cc8ab56d-57e3-400d-b45c-36f617f57ce5 req-411aeca2-53eb-4072-a534-7b74faea8a5d service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received unexpected event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with vm_state building and task_state spawning.
Aug 01 08:16:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "0debd99f-9724-42ed-8048-857edce10e6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "0debd99f-9724-42ed-8048-857edce10e6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "0debd99f-9724-42ed-8048-857edce10e6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "0debd99f-9724-42ed-8048-857edce10e6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "0debd99f-9724-42ed-8048-857edce10e6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:51 user nova-compute[72426]: INFO nova.compute.manager [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Terminating instance
Aug 01 08:16:51 user nova-compute[72426]: DEBUG nova.compute.manager [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-668cc975-e080-427d-b2de-90f537daf1ca req-dcfe1d89-1039-43e6-9915-97cd02de6896 service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Received event network-vif-unplugged-60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-668cc975-e080-427d-b2de-90f537daf1ca req-dcfe1d89-1039-43e6-9915-97cd02de6896 service nova] Acquiring lock "0debd99f-9724-42ed-8048-857edce10e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-668cc975-e080-427d-b2de-90f537daf1ca req-dcfe1d89-1039-43e6-9915-97cd02de6896 service nova] Lock "0debd99f-9724-42ed-8048-857edce10e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-668cc975-e080-427d-b2de-90f537daf1ca req-dcfe1d89-1039-43e6-9915-97cd02de6896 service nova] Lock "0debd99f-9724-42ed-8048-857edce10e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-668cc975-e080-427d-b2de-90f537daf1ca req-dcfe1d89-1039-43e6-9915-97cd02de6896 service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] No waiting events found dispatching network-vif-unplugged-60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-668cc975-e080-427d-b2de-90f537daf1ca req-dcfe1d89-1039-43e6-9915-97cd02de6896 service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Received event network-vif-unplugged-60c608b0-461b-46e4-b127-189bee33d399 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:16:51 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Instance destroyed successfully.
Aug 01 08:16:51 user nova-compute[72426]: DEBUG nova.objects.instance [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lazy-loading 'resources' on Instance uuid 0debd99f-9724-42ed-8048-857edce10e6f {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1912323582',display_name='tempest-VolumesActionsTest-instance-1912323582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1912323582',id=20,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc2a913710a44a50927c9e68e9807367',ramdisk_id='',reservation_id='r-cqe3ndse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-55827117',owner_user_name='tempest-VolumesActionsTest-55827117-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:15:07Z,user_data=None,user_id='2845bfd89e8e4057ac9464f5bf3b52be',uuid=0debd99f-9724-42ed-8048-857edce10e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60c608b0-461b-46e4-b127-189bee33d399", "address": "fa:16:3e:12:59:ce", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c608b0-46", "ovs_interfaceid": "60c608b0-461b-46e4-b127-189bee33d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converting VIF {"id": "60c608b0-461b-46e4-b127-189bee33d399", "address": "fa:16:3e:12:59:ce", "network": {"id": "6e9af617-bc97-4064-b9c7-7988c3c5baa3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1625511600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc2a913710a44a50927c9e68e9807367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c608b0-46", "ovs_interfaceid": "60c608b0-461b-46e4-b127-189bee33d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:59:ce,bridge_name='br-int',has_traffic_filtering=True,id=60c608b0-461b-46e4-b127-189bee33d399,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c608b0-46') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG os_vif [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:59:ce,bridge_name='br-int',has_traffic_filtering=True,id=60c608b0-461b-46e4-b127-189bee33d399,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c608b0-46') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60c608b0-46, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:16:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:16:51 user nova-compute[72426]: INFO os_vif [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:59:ce,bridge_name='br-int',has_traffic_filtering=True,id=60c608b0-461b-46e4-b127-189bee33d399,network=Network(6e9af617-bc97-4064-b9c7-7988c3c5baa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c608b0-46')
Aug 01 08:16:51 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Deleting instance files /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f_del
Aug 01 08:16:51 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Deletion of /opt/stack/data/nova/instances/0debd99f-9724-42ed-8048-857edce10e6f_del complete
Aug 01 08:16:52 user nova-compute[72426]: INFO nova.compute.manager [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 08:16:52 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877812.3853765, a5e525d1-9cbd-4e92-8eea-f256b6edd86e => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:16:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] VM Resumed (Lifecycle Event)
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:16:52 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Instance spawned successfully.
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:16:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877812.386492, a5e525d1-9cbd-4e92-8eea-f256b6edd86e => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:16:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] VM Started (Lifecycle Event)
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:16:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:16:52 user nova-compute[72426]: INFO nova.compute.manager [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Took 5.92 seconds to spawn the instance on the hypervisor.
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-e0a54db4-45cd-4ef3-89a9-10498c427de3 req-14ef891e-6275-4988-8f5c-dfcc43845d01 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e0a54db4-45cd-4ef3-89a9-10498c427de3 req-14ef891e-6275-4988-8f5c-dfcc43845d01 service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e0a54db4-45cd-4ef3-89a9-10498c427de3 req-14ef891e-6275-4988-8f5c-dfcc43845d01 service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e0a54db4-45cd-4ef3-89a9-10498c427de3 req-14ef891e-6275-4988-8f5c-dfcc43845d01 service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-e0a54db4-45cd-4ef3-89a9-10498c427de3 req-14ef891e-6275-4988-8f5c-dfcc43845d01 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:52 user nova-compute[72426]: WARNING nova.compute.manager [req-e0a54db4-45cd-4ef3-89a9-10498c427de3 req-14ef891e-6275-4988-8f5c-dfcc43845d01 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received unexpected event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with vm_state building and task_state spawning.
Aug 01 08:16:52 user nova-compute[72426]: INFO nova.compute.manager [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Took 6.70 seconds to build instance.
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:16:52 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Took 0.57 seconds to deallocate network for instance.
Aug 01 08:16:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4d54905c-f2c4-4b9f-91d0-094e0be24bd7 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.866s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:16:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:53 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Deleted allocations for instance 0debd99f-9724-42ed-8048-857edce10e6f
Aug 01 08:16:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d697585c-ab2f-47c0-82ba-d1a6d9b53bd5 tempest-VolumesActionsTest-55827117 tempest-VolumesActionsTest-55827117-project-member] Lock "0debd99f-9724-42ed-8048-857edce10e6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.944s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-0f29c650-7093-43af-b424-db2801bec3f7 req-c8dcc5d0-23a3-4db1-80ff-2950b1777343 service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Received event network-vif-plugged-60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f29c650-7093-43af-b424-db2801bec3f7 req-c8dcc5d0-23a3-4db1-80ff-2950b1777343 service nova] Acquiring lock "0debd99f-9724-42ed-8048-857edce10e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:16:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f29c650-7093-43af-b424-db2801bec3f7 req-c8dcc5d0-23a3-4db1-80ff-2950b1777343 service nova] Lock "0debd99f-9724-42ed-8048-857edce10e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:16:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f29c650-7093-43af-b424-db2801bec3f7 req-c8dcc5d0-23a3-4db1-80ff-2950b1777343 service nova] Lock "0debd99f-9724-42ed-8048-857edce10e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:16:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-0f29c650-7093-43af-b424-db2801bec3f7 req-c8dcc5d0-23a3-4db1-80ff-2950b1777343 service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] No waiting events found dispatching network-vif-plugged-60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:16:53 user nova-compute[72426]: WARNING nova.compute.manager [req-0f29c650-7093-43af-b424-db2801bec3f7 req-c8dcc5d0-23a3-4db1-80ff-2950b1777343 service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Received unexpected event network-vif-plugged-60c608b0-461b-46e4-b127-189bee33d399 for instance with vm_state deleted and task_state None.
Aug 01 08:16:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-d603de6b-a5e6-4ce8-a40c-88ff53ae9ca1 req-f2f3bc2c-095f-4c71-a52a-636080b91c62 service nova] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Received event network-vif-deleted-60c608b0-461b-46e4-b127-189bee33d399 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:16:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:16:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:06 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877811.951062, 0debd99f-9724-42ed-8048-857edce10e6f => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:06 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] VM Stopped (Lifecycle Event)
Aug 01 08:17:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bcab791d-ffe2-4cdd-963e-1148b06c8547 None None] [instance: 0debd99f-9724-42ed-8048-857edce10e6f] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "73fb06b8-0824-42fc-bbfd-6914bdb78824" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:17:12 user nova-compute[72426]: INFO nova.compute.claims [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Claim successful on node user
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.network.neutron [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:17:12 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.policy [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '184d71425948492e835ea8f0dd857d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b6971ed0a343468f071e1e25c27d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:17:12 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Creating image(s)
Aug 01 08:17:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "/opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "/opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "/opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:12 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk 1073741824" returned: 0 in 0.051s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG nova.network.neutron [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Successfully created port: 993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Cannot resize image /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG nova.objects.instance [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'migration_context' on Instance uuid 73fb06b8-0824-42fc-bbfd-6914bdb78824 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Ensure instance console log exists: /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.network.neutron [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Successfully updated port: 993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "refresh_cache-73fb06b8-0824-42fc-bbfd-6914bdb78824" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquired lock "refresh_cache-73fb06b8-0824-42fc-bbfd-6914bdb78824" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.network.neutron [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-a57aef9a-3137-4a4d-af0d-5a841f2f64b2 req-f98fbbad-3406-4603-9279-912f5bb7b593 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Received event network-changed-993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-a57aef9a-3137-4a4d-af0d-5a841f2f64b2 req-f98fbbad-3406-4603-9279-912f5bb7b593 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Refreshing instance network info cache due to event network-changed-993dc5e4-241f-4058-9dca-58a406286d19. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a57aef9a-3137-4a4d-af0d-5a841f2f64b2 req-f98fbbad-3406-4603-9279-912f5bb7b593 service nova] Acquiring lock "refresh_cache-73fb06b8-0824-42fc-bbfd-6914bdb78824" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.network.neutron [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.network.neutron [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Updating instance_info_cache with network_info: [{"id": "993dc5e4-241f-4058-9dca-58a406286d19", "address": "fa:16:3e:68:9c:0b", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993dc5e4-24", "ovs_interfaceid": "993dc5e4-241f-4058-9dca-58a406286d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Releasing lock "refresh_cache-73fb06b8-0824-42fc-bbfd-6914bdb78824" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Instance network_info: |[{"id": "993dc5e4-241f-4058-9dca-58a406286d19", "address": "fa:16:3e:68:9c:0b", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993dc5e4-24", "ovs_interfaceid": "993dc5e4-241f-4058-9dca-58a406286d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a57aef9a-3137-4a4d-af0d-5a841f2f64b2 req-f98fbbad-3406-4603-9279-912f5bb7b593 service nova] Acquired lock "refresh_cache-73fb06b8-0824-42fc-bbfd-6914bdb78824" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.network.neutron [req-a57aef9a-3137-4a4d-af0d-5a841f2f64b2 req-f98fbbad-3406-4603-9279-912f5bb7b593 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Refreshing network info cache for port 993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Start _get_guest_xml network_info=[{"id": "993dc5e4-241f-4058-9dca-58a406286d19", "address": "fa:16:3e:68:9c:0b", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993dc5e4-24", "ovs_interfaceid": "993dc5e4-241f-4058-9dca-58a406286d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:17:14 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:17:14 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1755267583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1755267583',id=24,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-yumkhyg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:17:13Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=73fb06b8-0824-42fc-bbfd-6914bdb78824,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "993dc5e4-241f-4058-9dca-58a406286d19", "address": "fa:16:3e:68:9c:0b", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993dc5e4-24", "ovs_interfaceid": "993dc5e4-241f-4058-9dca-58a406286d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "993dc5e4-241f-4058-9dca-58a406286d19", "address": "fa:16:3e:68:9c:0b", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993dc5e4-24", "ovs_interfaceid": "993dc5e4-241f-4058-9dca-58a406286d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=993dc5e4-241f-4058-9dca-58a406286d19,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993dc5e4-24') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.objects.instance [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'pci_devices' on Instance uuid 73fb06b8-0824-42fc-bbfd-6914bdb78824 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:17:14 user nova-compute[72426]:   <uuid>73fb06b8-0824-42fc-bbfd-6914bdb78824</uuid>
Aug 01 08:17:14 user nova-compute[72426]:   <name>instance-00000018</name>
Aug 01 08:17:14 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:17:14 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:17:14 user nova-compute[72426]:   <metadata>
Aug 01 08:17:14 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:17:14 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:17:14 user nova-compute[72426]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1755267583</nova:name>
Aug 01 08:17:14 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:17:14</nova:creationTime>
Aug 01 08:17:14 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:17:14 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:17:14 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:17:14 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:17:14 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:17:14 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:17:14 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:17:14 user nova-compute[72426]:       <nova:owner>
Aug 01 08:17:14 user nova-compute[72426]:         <nova:user uuid="184d71425948492e835ea8f0dd857d1f">tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member</nova:user>
Aug 01 08:17:14 user nova-compute[72426]:         <nova:project uuid="d0b6971ed0a343468f071e1e25c27d5b">tempest-ServerBootFromVolumeStableRescueTest-2030640431</nova:project>
Aug 01 08:17:14 user nova-compute[72426]:       </nova:owner>
Aug 01 08:17:14 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:17:14 user nova-compute[72426]:       <nova:ports>
Aug 01 08:17:14 user nova-compute[72426]:         <nova:port uuid="993dc5e4-241f-4058-9dca-58a406286d19">
Aug 01 08:17:14 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 08:17:14 user nova-compute[72426]:         </nova:port>
Aug 01 08:17:14 user nova-compute[72426]:       </nova:ports>
Aug 01 08:17:14 user nova-compute[72426]:     </nova:instance>
Aug 01 08:17:14 user nova-compute[72426]:   </metadata>
Aug 01 08:17:14 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:17:14 user nova-compute[72426]:     <system>
Aug 01 08:17:14 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:17:14 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:17:14 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:17:14 user nova-compute[72426]:       <entry name="serial">73fb06b8-0824-42fc-bbfd-6914bdb78824</entry>
Aug 01 08:17:14 user nova-compute[72426]:       <entry name="uuid">73fb06b8-0824-42fc-bbfd-6914bdb78824</entry>
Aug 01 08:17:14 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:17:14 user nova-compute[72426]:     </system>
Aug 01 08:17:14 user nova-compute[72426]:   </sysinfo>
Aug 01 08:17:14 user nova-compute[72426]:   <os>
Aug 01 08:17:14 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:17:14 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:17:14 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:17:14 user nova-compute[72426]:   </os>
Aug 01 08:17:14 user nova-compute[72426]:   <features>
Aug 01 08:17:14 user nova-compute[72426]:     <acpi/>
Aug 01 08:17:14 user nova-compute[72426]:     <apic/>
Aug 01 08:17:14 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:17:14 user nova-compute[72426]:   </features>
Aug 01 08:17:14 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:17:14 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:17:14 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:17:14 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:17:14 user nova-compute[72426]:   </clock>
Aug 01 08:17:14 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:17:14 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:17:14 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:17:14 user nova-compute[72426]:   </cpu>
Aug 01 08:17:14 user nova-compute[72426]:   <devices>
Aug 01 08:17:14 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:17:14 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:17:14 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk"/>
Aug 01 08:17:14 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:17:14 user nova-compute[72426]:     </disk>
Aug 01 08:17:14 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:17:14 user nova-compute[72426]:       <mac address="fa:16:3e:68:9c:0b"/>
Aug 01 08:17:14 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:17:14 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:17:14 user nova-compute[72426]:       <target dev="tap993dc5e4-24"/>
Aug 01 08:17:14 user nova-compute[72426]:     </interface>
Aug 01 08:17:14 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:17:14 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/console.log" append="off"/>
Aug 01 08:17:14 user nova-compute[72426]:     </serial>
Aug 01 08:17:14 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:17:14 user nova-compute[72426]:     <video>
Aug 01 08:17:14 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:17:14 user nova-compute[72426]:     </video>
Aug 01 08:17:14 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:17:14 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:17:14 user nova-compute[72426]:     </rng>
Aug 01 08:17:14 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:17:14 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:17:14 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:17:14 user nova-compute[72426]:     </memballoon>
Aug 01 08:17:14 user nova-compute[72426]:   </devices>
Aug 01 08:17:14 user nova-compute[72426]: </domain>
Aug 01 08:17:14 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1755267583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1755267583',id=24,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-yumkhyg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:17:13Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=73fb06b8-0824-42fc-bbfd-6914bdb78824,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "993dc5e4-241f-4058-9dca-58a406286d19", "address": "fa:16:3e:68:9c:0b", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993dc5e4-24", "ovs_interfaceid": "993dc5e4-241f-4058-9dca-58a406286d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "993dc5e4-241f-4058-9dca-58a406286d19", "address": "fa:16:3e:68:9c:0b", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993dc5e4-24", "ovs_interfaceid": "993dc5e4-241f-4058-9dca-58a406286d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=993dc5e4-241f-4058-9dca-58a406286d19,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993dc5e4-24') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG os_vif [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=993dc5e4-241f-4058-9dca-58a406286d19,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993dc5e4-24') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap993dc5e4-24, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap993dc5e4-24, col_values=(('external_ids', {'iface-id': '993dc5e4-241f-4058-9dca-58a406286d19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:9c:0b', 'vm-uuid': '73fb06b8-0824-42fc-bbfd-6914bdb78824'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:14 user nova-compute[72426]: INFO os_vif [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=993dc5e4-241f-4058-9dca-58a406286d19,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993dc5e4-24')
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:17:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No VIF found with MAC fa:16:3e:68:9c:0b, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:17:15 user nova-compute[72426]: DEBUG nova.network.neutron [req-a57aef9a-3137-4a4d-af0d-5a841f2f64b2 req-f98fbbad-3406-4603-9279-912f5bb7b593 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Updated VIF entry in instance network info cache for port 993dc5e4-241f-4058-9dca-58a406286d19. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:17:15 user nova-compute[72426]: DEBUG nova.network.neutron [req-a57aef9a-3137-4a4d-af0d-5a841f2f64b2 req-f98fbbad-3406-4603-9279-912f5bb7b593 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Updating instance_info_cache with network_info: [{"id": "993dc5e4-241f-4058-9dca-58a406286d19", "address": "fa:16:3e:68:9c:0b", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993dc5e4-24", "ovs_interfaceid": "993dc5e4-241f-4058-9dca-58a406286d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a57aef9a-3137-4a4d-af0d-5a841f2f64b2 req-f98fbbad-3406-4603-9279-912f5bb7b593 service nova] Releasing lock "refresh_cache-73fb06b8-0824-42fc-bbfd-6914bdb78824" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-68a4e52e-7e63-4b40-b404-1e3c5369eaf3 req-c973b28b-5b61-4cf9-a913-ee1cf74cf80d service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Received event network-vif-plugged-993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-68a4e52e-7e63-4b40-b404-1e3c5369eaf3 req-c973b28b-5b61-4cf9-a913-ee1cf74cf80d service nova] Acquiring lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-68a4e52e-7e63-4b40-b404-1e3c5369eaf3 req-c973b28b-5b61-4cf9-a913-ee1cf74cf80d service nova] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-68a4e52e-7e63-4b40-b404-1e3c5369eaf3 req-c973b28b-5b61-4cf9-a913-ee1cf74cf80d service nova] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-68a4e52e-7e63-4b40-b404-1e3c5369eaf3 req-c973b28b-5b61-4cf9-a913-ee1cf74cf80d service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] No waiting events found dispatching network-vif-plugged-993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:16 user nova-compute[72426]: WARNING nova.compute.manager [req-68a4e52e-7e63-4b40-b404-1e3c5369eaf3 req-c973b28b-5b61-4cf9-a913-ee1cf74cf80d service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Received unexpected event network-vif-plugged-993dc5e4-241f-4058-9dca-58a406286d19 for instance with vm_state building and task_state spawning.
Aug 01 08:17:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877838.6060526, 73fb06b8-0824-42fc-bbfd-6914bdb78824 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:18 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] VM Resumed (Lifecycle Event)
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:17:18 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Instance spawned successfully.
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:17:18 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877838.6094282, 73fb06b8-0824-42fc-bbfd-6914bdb78824 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:18 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] VM Started (Lifecycle Event)
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:17:18 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:17:18 user nova-compute[72426]: INFO nova.compute.manager [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:18 user nova-compute[72426]: INFO nova.compute.manager [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Took 6.55 seconds to build instance.
Aug 01 08:17:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-514d4ad4-eda5-4c87-bdac-be8df5dc5960 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.659s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-1099baaa-6e84-4a29-a2ba-6c6c72cbe885 req-4941b55e-01d3-4f5d-a386-562b555c656f service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Received event network-vif-plugged-993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1099baaa-6e84-4a29-a2ba-6c6c72cbe885 req-4941b55e-01d3-4f5d-a386-562b555c656f service nova] Acquiring lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1099baaa-6e84-4a29-a2ba-6c6c72cbe885 req-4941b55e-01d3-4f5d-a386-562b555c656f service nova] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1099baaa-6e84-4a29-a2ba-6c6c72cbe885 req-4941b55e-01d3-4f5d-a386-562b555c656f service nova] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-1099baaa-6e84-4a29-a2ba-6c6c72cbe885 req-4941b55e-01d3-4f5d-a386-562b555c656f service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] No waiting events found dispatching network-vif-plugged-993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:18 user nova-compute[72426]: WARNING nova.compute.manager [req-1099baaa-6e84-4a29-a2ba-6c6c72cbe885 req-4941b55e-01d3-4f5d-a386-562b555c656f service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Received unexpected event network-vif-plugged-993dc5e4-241f-4058-9dca-58a406286d19 for instance with vm_state active and task_state None.
Aug 01 08:17:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-5bc2aa54-ab4a-48da-9d81-5b0cd90f1659 req-88284872-c325-4a11-a06f-654e46703877 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received event network-changed-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-5bc2aa54-ab4a-48da-9d81-5b0cd90f1659 req-88284872-c325-4a11-a06f-654e46703877 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Refreshing instance network info cache due to event network-changed-67f23dc9-1d5d-49d5-af3e-eefebe684941. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:17:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5bc2aa54-ab4a-48da-9d81-5b0cd90f1659 req-88284872-c325-4a11-a06f-654e46703877 service nova] Acquiring lock "refresh_cache-551a28bf-12d3-419b-bfb9-6e10647de1ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:17:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5bc2aa54-ab4a-48da-9d81-5b0cd90f1659 req-88284872-c325-4a11-a06f-654e46703877 service nova] Acquired lock "refresh_cache-551a28bf-12d3-419b-bfb9-6e10647de1ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:17:24 user nova-compute[72426]: DEBUG nova.network.neutron [req-5bc2aa54-ab4a-48da-9d81-5b0cd90f1659 req-88284872-c325-4a11-a06f-654e46703877 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Refreshing network info cache for port 67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:17:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "551a28bf-12d3-419b-bfb9-6e10647de1ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:25 user nova-compute[72426]: INFO nova.compute.manager [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Terminating instance
Aug 01 08:17:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG nova.network.neutron [req-5bc2aa54-ab4a-48da-9d81-5b0cd90f1659 req-88284872-c325-4a11-a06f-654e46703877 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Updated VIF entry in instance network info cache for port 67f23dc9-1d5d-49d5-af3e-eefebe684941. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG nova.network.neutron [req-5bc2aa54-ab4a-48da-9d81-5b0cd90f1659 req-88284872-c325-4a11-a06f-654e46703877 service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Updating instance_info_cache with network_info: [{"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5bc2aa54-ab4a-48da-9d81-5b0cd90f1659 req-88284872-c325-4a11-a06f-654e46703877 service nova] Releasing lock "refresh_cache-551a28bf-12d3-419b-bfb9-6e10647de1ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:26 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Instance destroyed successfully.
Aug 01 08:17:26 user nova-compute[72426]: DEBUG nova.objects.instance [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lazy-loading 'resources' on Instance uuid 551a28bf-12d3-419b-bfb9-6e10647de1ac {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-469032252',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-469032252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-469032252',id=21,image_ref='25368259-1a0d-4e01-8fba-32436a460ec8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+YpFAtCQTQQ+qDog31kSoyxSuZtNMBF5YXLisoHGzLTzEoeaSA2f+DmOlN0415wDAULX+hlZXFJeswkxB43oY5VTTsx75Dz+WVDII7Kdku+DTXsWi+0aW79LgaC+hL9Q==',key_name='tempest-keypair-914881832',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:15:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-waqa73x9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-942085866',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=551a28bf-12d3-419b-bfb9-6e10647de1ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "address": "fa:16:3e:d6:4b:33", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f23dc9-1d", "ovs_interfaceid": "67f23dc9-1d5d-49d5-af3e-eefebe684941", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=67f23dc9-1d5d-49d5-af3e-eefebe684941,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f23dc9-1d') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_vif [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=67f23dc9-1d5d-49d5-af3e-eefebe684941,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f23dc9-1d') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67f23dc9-1d, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:26 user nova-compute[72426]: INFO os_vif [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:4b:33,bridge_name='br-int',has_traffic_filtering=True,id=67f23dc9-1d5d-49d5-af3e-eefebe684941,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f23dc9-1d')
Aug 01 08:17:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKAGDZMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:17:26 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fd8c4c-453d-442e-ae3a-198435f45f29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e088df71-28e6-4902-ad02-79c7ffa1413b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:17:26 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:17:26 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:17:26 user nova-compute[72426]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)
Aug 01 08:17:26 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:17:26 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:17:26 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:17:26 user nova-compute[72426]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c (non-flash)
Aug 01 08:17:26 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c3996c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[57669194-2e04-430a-bbde-a0e0b228c712]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbe3aa1-5047-4414-8849-bd1dccada996]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[832a9e76-9a60-4523-b437-7e8e0fe6ea30]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef77b9c-4258-483a-82de-1c4f4633f7a2]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[379e39e6-484f-4579-9222-cb096457aac3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd42895-80a0-4297-b183-569a3dc4c522]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c, portal: 172.16.0.220,3260]
Aug 01 08:17:26 user nova-compute[72426]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c, portal: 172.16.0.220,3260] successful.
Aug 01 08:17:26 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcf0f43a-6502-4277-8b4e-9c5566c6d67c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[202ca0a4-ec0f-4b37-96e6-2d274974712f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== disconnect_volume: return (429ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:17:26 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Deleting instance files /opt/stack/data/nova/instances/551a28bf-12d3-419b-bfb9-6e10647de1ac_del
Aug 01 08:17:26 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Deletion of /opt/stack/data/nova/instances/551a28bf-12d3-419b-bfb9-6e10647de1ac_del complete
Aug 01 08:17:26 user nova-compute[72426]: INFO nova.compute.manager [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Took 1.48 seconds to destroy the instance on the hypervisor.
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid '551a28bf-12d3-419b-bfb9-6e10647de1ac' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid '551a28bf-12d3-419b-bfb9-6e10647de1ac' (instance-00000015)
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received event network-vif-unplugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] Acquiring lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] No waiting events found dispatching network-vif-unplugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received event network-vif-unplugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received event network-vif-plugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] Acquiring lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] No waiting events found dispatching network-vif-plugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:27 user nova-compute[72426]: WARNING nova.compute.manager [req-1cfecc8a-e33c-4e4e-9925-8968fb9658df req-cd784e8e-88e2-43b5-96e9-0a873758233d service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received unexpected event network-vif-plugged-67f23dc9-1d5d-49d5-af3e-eefebe684941 for instance with vm_state active and task_state deleting.
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.008s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:27 user nova-compute[72426]: INFO nova.compute.manager [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Terminating instance
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.compute.manager [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-d24bd6e1-5d1a-4201-b113-1af6b16f5ed7 req-c8b68d4c-160e-426e-861d-596c3eeb741f service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Received event network-vif-deleted-67f23dc9-1d5d-49d5-af3e-eefebe684941 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:27 user nova-compute[72426]: INFO nova.compute.manager [req-d24bd6e1-5d1a-4201-b113-1af6b16f5ed7 req-c8b68d4c-160e-426e-861d-596c3eeb741f service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Neutron deleted interface 67f23dc9-1d5d-49d5-af3e-eefebe684941; detaching it from the instance and deleting it from the info cache
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.network.neutron [req-d24bd6e1-5d1a-4201-b113-1af6b16f5ed7 req-c8b68d4c-160e-426e-861d-596c3eeb741f service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-d24bd6e1-5d1a-4201-b113-1af6b16f5ed7 req-c8b68d4c-160e-426e-861d-596c3eeb741f service nova] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Detach interface failed, port_id=67f23dc9-1d5d-49d5-af3e-eefebe684941, reason: Instance 551a28bf-12d3-419b-bfb9-6e10647de1ac could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:17:27 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Took 1.12 seconds to deallocate network for instance.
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Instance destroyed successfully.
Aug 01 08:17:28 user nova-compute[72426]: DEBUG nova.objects.instance [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lazy-loading 'resources' on Instance uuid dad9feb1-d5fa-4ed2-9fe3-1573010446f6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-422374365',display_name='tempest-ServerActionsTestOtherB-server-422374365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-422374365',id=4,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLl2oApS4LEi4Ig2bO8yUSo9wl16TwUkqqncZenLkty2XY524bkKbL5wZtWU4/2TUExag9ZWoRoLkyDVuWFoEcjk8zjc/94JyqcQHN/o4NaNjQ0nXMRCRju0bzFZ7w6HLQ==',key_name='tempest-keypair-1006503589',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:14:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32d0ba9feb9244e88cb3945f553c8ac7',ramdisk_id='',reservation_id='r-zqp59lbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-252722777',owner_user_name='tempest-ServerActionsTestOtherB-252722777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fec3b4665a148e498a731cfeef7f589',uuid=dad9feb1-d5fa-4ed2-9fe3-1573010446f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converting VIF {"id": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "address": "fa:16:3e:84:24:c8", "network": {"id": "46d83935-8ba5-4a65-9fce-050143e9465d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-958659898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32d0ba9feb9244e88cb3945f553c8ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap197ec10c-39", "ovs_interfaceid": "197ec10c-39a4-4c89-b675-b7bb2ee90b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_vif [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap197ec10c-39, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:17:28 user nova-compute[72426]: INFO os_vif [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f,network=Network(46d83935-8ba5-4a65-9fce-050143e9465d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap197ec10c-39')
Aug 01 08:17:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuUPAKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:17:28 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[82103382-d548-4ae1-8b00-c413a0d02038]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbc91cd-bee1-45da-bcd7-7dce31a4f8fe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:17:28 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:17:28 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:17:28 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:17:28 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:17:28 user nova-compute[72426]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e (non-flash)
Aug 01 08:17:28 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c39b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e'): ({'sdd'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Removing single pathed devices sdd {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a64ddb-fd8a-48c3-8315-1ef082b4b904]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.035s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad5c77b-51bf-46b1-9549-938a1aec71a8]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Flushing IO for device /dev/sdd {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ad10b-e55e-4f6b-9f3e-4dc9819aa1f2]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fc1b15-a47f-40c1-a06c-83e62e98a4d4]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d748e6-fa59-48db-b483-f45a84b899c5]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:28 user nova-compute[72426]: INFO nova.compute.manager [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Took 1.02 seconds to detach 1 volumes for instance.
Aug 01 08:17:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Deleting volume: dcf0f43a-6502-4277-8b4e-9c5566c6d67c {{(pid=72426) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 08:17:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --logout" returned: 0 in 0.132s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0de3719-21a6-4c29-b027-eba48f92fb0a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260]
Aug 01 08:17:29 user nova-compute[72426]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e, portal: 172.16.0.220,3260] successful.
Aug 01 08:17:29 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-unplugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-unplugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-unplugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] Acquiring lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] No waiting events found dispatching network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:29 user nova-compute[72426]: WARNING nova.compute.manager [req-8f446a00-0a4f-4696-8a15-f38fcac3afe9 req-877200ec-9174-4449-9475-4deb86a7df33 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received unexpected event network-vif-plugged-197ec10c-39a4-4c89-b675-b7bb2ee90b1f for instance with vm_state active and task_state deleting.
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46683ff1-19fb-4c9c-8af3-48f1e1fcc57e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d66840-f3d9-47a5-a3c1-6adb161ecd7f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.586s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] <== disconnect_volume: return (588ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:17:29 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Deleting instance files /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6_del
Aug 01 08:17:29 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Deletion of /opt/stack/data/nova/instances/dad9feb1-d5fa-4ed2-9fe3-1573010446f6_del complete
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:29 user nova-compute[72426]: INFO nova.compute.manager [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Took 1.68 seconds to destroy the instance on the hypervisor.
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "2572e472-73fe-4e5a-b486-e38274a978d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.733s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.412s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:30 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Deleted allocations for instance 551a28bf-12d3-419b-bfb9-6e10647de1ac
Aug 01 08:17:30 user nova-compute[72426]: DEBUG nova.compute.manager [req-ac9ec4c3-c78f-4823-88cf-efb271120bb3 req-4bfeb851-e691-449c-af6a-67baeab263c0 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Received event network-vif-deleted-197ec10c-39a4-4c89-b675-b7bb2ee90b1f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:30 user nova-compute[72426]: INFO nova.compute.manager [req-ac9ec4c3-c78f-4823-88cf-efb271120bb3 req-4bfeb851-e691-449c-af6a-67baeab263c0 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Neutron deleted interface 197ec10c-39a4-4c89-b675-b7bb2ee90b1f; detaching it from the instance and deleting it from the info cache
Aug 01 08:17:30 user nova-compute[72426]: DEBUG nova.network.neutron [req-ac9ec4c3-c78f-4823-88cf-efb271120bb3 req-4bfeb851-e691-449c-af6a-67baeab263c0 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:30 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:17:30 user nova-compute[72426]: INFO nova.compute.claims [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Claim successful on node user
Aug 01 08:17:30 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:30 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:17:30 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:17:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7385MB free_disk=25.63766098022461GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:17:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:30 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Took 1.27 seconds to deallocate network for instance.
Aug 01 08:17:30 user nova-compute[72426]: DEBUG nova.compute.manager [req-ac9ec4c3-c78f-4823-88cf-efb271120bb3 req-4bfeb851-e691-449c-af6a-67baeab263c0 service nova] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Detach interface failed, port_id=197ec10c-39a4-4c89-b675-b7bb2ee90b1f, reason: Instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:17:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-75757b08-9f62-40a2-aa74-d416d2c3041e tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "551a28bf-12d3-419b-bfb9-6e10647de1ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.390s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.164s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.568s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.network.neutron [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:17:31 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2236c44a-562a-4b67-a487-ad51180dbaa0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 73fb06b8-0824-42fc-bbfd-6914bdb78824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2572e472-73fe-4e5a-b486-e38274a978d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:17:31 user nova-compute[72426]: INFO nova.virt.block_device [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Booting with volume 1ba8f463-9a40-4627-bb28-92ef381bde3a at /dev/vda
Aug 01 08:17:31 user nova-compute[72426]: DEBUG os_brick.utils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a41dddc-f70e-4a47-9ca5-a824c6640fd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d240182-e85c-4a93-ad22-2a09630b1ac3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.policy [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63a663fe54d7469a97f5642e0847a2d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77facd98c6ac4726939b5599e6c72a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fa8df0-7293-4bcd-bd69-cb759a29f2d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d2d81c-9c6b-484b-8a0d-49c092558249]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:17:31 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[705dc9d0-1b81-48ad-a553-96dd19080324]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG os_brick.utils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating existing volume attachment record: 5911386f-1be1-4640-a446-98637d9c622b {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:17:31 user nova-compute[72426]: INFO nova.compute.manager [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Took 1.05 seconds to detach 1 volumes for instance.
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.170s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:32 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:17:32 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:17:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:32 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Deleted allocations for instance dad9feb1-d5fa-4ed2-9fe3-1573010446f6
Aug 01 08:17:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-adcc9466-063e-4330-be32-5cfded459b9e tempest-ServerActionsTestOtherB-252722777 tempest-ServerActionsTestOtherB-252722777-project-member] Lock "dad9feb1-d5fa-4ed2-9fe3-1573010446f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.904s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:32 user nova-compute[72426]: DEBUG nova.network.neutron [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Successfully created port: 4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG nova.network.neutron [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Successfully updated port: 4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquired lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG nova.network.neutron [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-4b588707-8ce8-4734-9701-269cf44d3741 req-e2a09aca-7936-4f63-a6b2-c00f9a53cea5 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-changed-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-4b588707-8ce8-4734-9701-269cf44d3741 req-e2a09aca-7936-4f63-a6b2-c00f9a53cea5 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Refreshing instance network info cache due to event network-changed-4f7d2fe1-5bf7-4270-a15a-11c145726e16. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4b588707-8ce8-4734-9701-269cf44d3741 req-e2a09aca-7936-4f63-a6b2-c00f9a53cea5 service nova] Acquiring lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG nova.network.neutron [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG nova.network.neutron [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating instance_info_cache with network_info: [{"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Releasing lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Instance network_info: |[{"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4b588707-8ce8-4734-9701-269cf44d3741 req-e2a09aca-7936-4f63-a6b2-c00f9a53cea5 service nova] Acquired lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:17:33 user nova-compute[72426]: DEBUG nova.network.neutron [req-4b588707-8ce8-4734-9701-269cf44d3741 req-e2a09aca-7936-4f63-a6b2-c00f9a53cea5 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Refreshing network info cache for port 4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:17:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-4b588707-8ce8-4734-9701-269cf44d3741 req-e2a09aca-7936-4f63-a6b2-c00f9a53cea5 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updated VIF entry in instance network info cache for port 4f7d2fe1-5bf7-4270-a15a-11c145726e16. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:17:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-4b588707-8ce8-4734-9701-269cf44d3741 req-e2a09aca-7936-4f63-a6b2-c00f9a53cea5 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating instance_info_cache with network_info: [{"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4b588707-8ce8-4734-9701-269cf44d3741 req-e2a09aca-7936-4f63-a6b2-c00f9a53cea5 service nova] Releasing lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:17:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:17:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:17:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:17:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:17:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:17:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:17:35 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updating instance_info_cache with network_info: [{"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:17:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:17:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:17:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:17:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:17:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:17:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:17:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:17:36 user nova-compute[72426]: INFO nova.compute.claims [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Claim successful on node user
Aug 01 08:17:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:17:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:17:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG nova.policy [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46cce858652440719bed7e5473ffb18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb29b81c84c9bb0b49c8bdb107d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:17:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Creating image(s)
Aug 01 08:17:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "/opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "/opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "/opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "6e3abd2642be3e6e6d736461414db66b2e7ffbd0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "6e3abd2642be3e6e6d736461414db66b2e7ffbd0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0.part --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0.part --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:37 user nova-compute[72426]: DEBUG nova.virt.images [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] 6080de30-d80c-4ca7-890f-c3b91f52f7df was qcow2, converting to raw {{(pid=72426) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0.part /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0.converted {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0.part /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0.converted" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0.converted --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "6e3abd2642be3e6e6d736461414db66b2e7ffbd0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.859s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0 --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "6e3abd2642be3e6e6d736461414db66b2e7ffbd0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "6e3abd2642be3e6e6d736461414db66b2e7ffbd0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0 --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0,backing_fmt=raw /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0,backing_fmt=raw /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk 1073741824" returned: 0 in 0.050s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "6e3abd2642be3e6e6d736461414db66b2e7ffbd0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0 --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Successfully created port: 725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Cannot resize image /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG nova.objects.instance [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'migration_context' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Ensure instance console log exists: /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:17:39 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Creating image(s)
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Ensure instance console log exists: /opt/stack/data/nova/instances/2572e472-73fe-4e5a-b486-e38274a978d7/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Start _get_guest_xml network_info=[{"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUPEtQHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2572e472-73fe-4e5a-b486-e38274a978d7', 'attached_at': '', 'detached_at': '', 'volume_id': '1ba8f463-9a40-4627-bb28-92ef381bde3a', 'serial': '1ba8f463-9a40-4627-bb28-92ef381bde3a'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '5911386f-1be1-4640-a446-98637d9c622b', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:17:39 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:17:39 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUPEtQHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:17:39 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:17:39 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:17:39 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ee227c-6c31-4a60-9a5a-914b5477b5b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:17:39 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c52f9f-119b-4437-8e57-84c519607965]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a] added
Aug 01 08:17:39 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b91414-281f-45ff-88da-df059ae16212]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e71db8-6ad6-483e-a946-346f09fffa8e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUPEtQHh {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUPEtQHh" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ca626f-37cb-4724-b6da-5e6b253e16c0]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eUPEtQHh'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a505ab9-015d-4fe1-979f-2cea43552ca6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[62de513b-0893-4b01-98b3-5a734362a5a8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:17:39 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:17:39 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:17:39 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:17:39 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Successfully updated port: 725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquired lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.compute.manager [req-285f1428-67a4-4114-a6f1-9e667db3ed35 req-3e964330-7873-4a34-b00a-0fcb79c37263 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-changed-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:39 user nova-compute[72426]: DEBUG nova.compute.manager [req-285f1428-67a4-4114-a6f1-9e667db3ed35 req-3e964330-7873-4a34-b00a-0fcb79c37263 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Refreshing instance network info cache due to event network-changed-725650f1-c621-47c2-bb87-a85d41c698d3. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-285f1428-67a4-4114-a6f1-9e667db3ed35 req-3e964330-7873-4a34-b00a-0fcb79c37263 service nova] Acquiring lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[348f641b-881e-49b7-a3d2-ca89142d2752]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260]
Aug 01 08:17:40 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260] successful.
Aug 01 08:17:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.061s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1103cab-97e0-42b0-93ee-b4a236adbb83]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65be72f-9aed-433d-bbf4-d3a8d46e37d5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:17:40 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:17:40 user nova-compute[72426]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:17:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:17:40 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:17:40 user nova-compute[72426]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:17:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[34acf780-366b-465e-94d5-13e145bc2e79]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUPEtQHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updating instance_info_cache with network_info: [{"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Releasing lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Instance network_info: |[{"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-285f1428-67a4-4114-a6f1-9e667db3ed35 req-3e964330-7873-4a34-b00a-0fcb79c37263 service nova] Acquired lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.network.neutron [req-285f1428-67a4-4114-a6f1-9e667db3ed35 req-3e964330-7873-4a34-b00a-0fcb79c37263 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Refreshing network info cache for port 725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Start _get_guest_xml network_info=[{"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:17:33Z,direct_url=<?>,disk_format='qcow2',id=6080de30-d80c-4ca7-890f-c3b91f52f7df,min_disk=0,min_ram=0,name='tempest-scenario-img--405800791',owner='85beb29b81c84c9bb0b49c8bdb107d50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:17:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '6080de30-d80c-4ca7-890f-c3b91f52f7df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:17:40 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:17:40 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:17:33Z,direct_url=<?>,disk_format='qcow2',id=6080de30-d80c-4ca7-890f-c3b91f52f7df,min_disk=0,min_ram=0,name='tempest-scenario-img--405800791',owner='85beb29b81c84c9bb0b49c8bdb107d50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:17:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1203897786',display_name='tempest-TestMinimumBasicScenario-server-1203897786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1203897786',id=26,image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaUW+O2gXcs5Qlc9T+gdA+5NS0imiYGw6BG+/0Lan/Dk2AXl3sI2AxVbrhv3fSt5K7N28XqNEPLWtlUEs1dy0X6Wd/7PlKxrwd7J5dxnOgWb2xNIOi/3d+UGC37t1MUHQ==',key_name='tempest-TestMinimumBasicScenario-680132469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85beb29b81c84c9bb0b49c8bdb107d50',ramdisk_id='',reservation_id='r-k2ymo0md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-307605778',owner_user_name='tempest-TestMinimumBasicScenario-307605778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:17:37Z,user_data=None,user_id='46cce858652440719bed7e5473ffb18d',uuid=adcf2dea-a758-4e13-9091-fffa6339f670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converting VIF {"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.objects.instance [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'pci_devices' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:17:40 user nova-compute[72426]:   <uuid>adcf2dea-a758-4e13-9091-fffa6339f670</uuid>
Aug 01 08:17:40 user nova-compute[72426]:   <name>instance-0000001a</name>
Aug 01 08:17:40 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:17:40 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:17:40 user nova-compute[72426]:   <metadata>
Aug 01 08:17:40 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:17:40 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:17:40 user nova-compute[72426]:       <nova:name>tempest-TestMinimumBasicScenario-server-1203897786</nova:name>
Aug 01 08:17:40 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:17:40</nova:creationTime>
Aug 01 08:17:40 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:17:40 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:17:40 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:17:40 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:17:40 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:17:40 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:17:40 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:17:40 user nova-compute[72426]:       <nova:owner>
Aug 01 08:17:40 user nova-compute[72426]:         <nova:user uuid="46cce858652440719bed7e5473ffb18d">tempest-TestMinimumBasicScenario-307605778-project-member</nova:user>
Aug 01 08:17:40 user nova-compute[72426]:         <nova:project uuid="85beb29b81c84c9bb0b49c8bdb107d50">tempest-TestMinimumBasicScenario-307605778</nova:project>
Aug 01 08:17:40 user nova-compute[72426]:       </nova:owner>
Aug 01 08:17:40 user nova-compute[72426]:       <nova:root type="image" uuid="6080de30-d80c-4ca7-890f-c3b91f52f7df"/>
Aug 01 08:17:40 user nova-compute[72426]:       <nova:ports>
Aug 01 08:17:40 user nova-compute[72426]:         <nova:port uuid="725650f1-c621-47c2-bb87-a85d41c698d3">
Aug 01 08:17:40 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 08:17:40 user nova-compute[72426]:         </nova:port>
Aug 01 08:17:40 user nova-compute[72426]:       </nova:ports>
Aug 01 08:17:40 user nova-compute[72426]:     </nova:instance>
Aug 01 08:17:40 user nova-compute[72426]:   </metadata>
Aug 01 08:17:40 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:17:40 user nova-compute[72426]:     <system>
Aug 01 08:17:40 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:17:40 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:17:40 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:17:40 user nova-compute[72426]:       <entry name="serial">adcf2dea-a758-4e13-9091-fffa6339f670</entry>
Aug 01 08:17:40 user nova-compute[72426]:       <entry name="uuid">adcf2dea-a758-4e13-9091-fffa6339f670</entry>
Aug 01 08:17:40 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:17:40 user nova-compute[72426]:     </system>
Aug 01 08:17:40 user nova-compute[72426]:   </sysinfo>
Aug 01 08:17:40 user nova-compute[72426]:   <os>
Aug 01 08:17:40 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:17:40 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:17:40 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:17:40 user nova-compute[72426]:   </os>
Aug 01 08:17:40 user nova-compute[72426]:   <features>
Aug 01 08:17:40 user nova-compute[72426]:     <acpi/>
Aug 01 08:17:40 user nova-compute[72426]:     <apic/>
Aug 01 08:17:40 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:17:40 user nova-compute[72426]:   </features>
Aug 01 08:17:40 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:17:40 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:17:40 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:17:40 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:17:40 user nova-compute[72426]:   </clock>
Aug 01 08:17:40 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:17:40 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:17:40 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:17:40 user nova-compute[72426]:   </cpu>
Aug 01 08:17:40 user nova-compute[72426]:   <devices>
Aug 01 08:17:40 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:17:40 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:17:40 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk"/>
Aug 01 08:17:40 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:17:40 user nova-compute[72426]:     </disk>
Aug 01 08:17:40 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:17:40 user nova-compute[72426]:       <mac address="fa:16:3e:48:94:bf"/>
Aug 01 08:17:40 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:17:40 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:17:40 user nova-compute[72426]:       <target dev="tap725650f1-c6"/>
Aug 01 08:17:40 user nova-compute[72426]:     </interface>
Aug 01 08:17:40 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:17:40 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/console.log" append="off"/>
Aug 01 08:17:40 user nova-compute[72426]:     </serial>
Aug 01 08:17:40 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:17:40 user nova-compute[72426]:     <video>
Aug 01 08:17:40 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:17:40 user nova-compute[72426]:     </video>
Aug 01 08:17:40 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:17:40 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:17:40 user nova-compute[72426]:     </rng>
Aug 01 08:17:40 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:17:40 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:17:40 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:17:40 user nova-compute[72426]:     </memballoon>
Aug 01 08:17:40 user nova-compute[72426]:   </devices>
Aug 01 08:17:40 user nova-compute[72426]: </domain>
Aug 01 08:17:40 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1203897786',display_name='tempest-TestMinimumBasicScenario-server-1203897786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1203897786',id=26,image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaUW+O2gXcs5Qlc9T+gdA+5NS0imiYGw6BG+/0Lan/Dk2AXl3sI2AxVbrhv3fSt5K7N28XqNEPLWtlUEs1dy0X6Wd/7PlKxrwd7J5dxnOgWb2xNIOi/3d+UGC37t1MUHQ==',key_name='tempest-TestMinimumBasicScenario-680132469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85beb29b81c84c9bb0b49c8bdb107d50',ramdisk_id='',reservation_id='r-k2ymo0md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-307605778',owner_user_name='tempest-TestMinimumBasicScenario-307605778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:17:37Z,user_data=None,user_id='46cce858652440719bed7e5473ffb18d',uuid=adcf2dea-a758-4e13-9091-fffa6339f670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converting VIF {"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG os_vif [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap725650f1-c6, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap725650f1-c6, col_values=(('external_ids', {'iface-id': '725650f1-c621-47c2-bb87-a85d41c698d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:94:bf', 'vm-uuid': 'adcf2dea-a758-4e13-9091-fffa6339f670'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:40 user nova-compute[72426]: INFO os_vif [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6')
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:17:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] No VIF found with MAC fa:16:3e:48:94:bf, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877846.1336603, 551a28bf-12d3-419b-bfb9-6e10647de1ac => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:41 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] VM Stopped (Lifecycle Event)
Aug 01 08:17:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23236313764633730', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236313764633730', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-103e1cd3-068e-4a8f-8a2c-02c750a7bd48 None None] [instance: 551a28bf-12d3-419b-bfb9-6e10647de1ac] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2008460603',display_name='tempest-ServerActionsTestOtherA-server-2008460603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2008460603',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-fivwx9jg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=2572e472-73fe-4e5a-b486-e38274a978d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.objects.instance [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'pci_devices' on Instance uuid 2572e472-73fe-4e5a-b486-e38274a978d7 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:17:41 user nova-compute[72426]:   <uuid>2572e472-73fe-4e5a-b486-e38274a978d7</uuid>
Aug 01 08:17:41 user nova-compute[72426]:   <name>instance-00000019</name>
Aug 01 08:17:41 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:17:41 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:17:41 user nova-compute[72426]:   <metadata>
Aug 01 08:17:41 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:17:41 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:17:41 user nova-compute[72426]:       <nova:name>tempest-ServerActionsTestOtherA-server-2008460603</nova:name>
Aug 01 08:17:41 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:17:39</nova:creationTime>
Aug 01 08:17:41 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:17:41 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:17:41 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:17:41 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:17:41 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:17:41 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:17:41 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:17:41 user nova-compute[72426]:       <nova:owner>
Aug 01 08:17:41 user nova-compute[72426]:         <nova:user uuid="63a663fe54d7469a97f5642e0847a2d4">tempest-ServerActionsTestOtherA-355781192-project-member</nova:user>
Aug 01 08:17:41 user nova-compute[72426]:         <nova:project uuid="77facd98c6ac4726939b5599e6c72a9b">tempest-ServerActionsTestOtherA-355781192</nova:project>
Aug 01 08:17:41 user nova-compute[72426]:       </nova:owner>
Aug 01 08:17:41 user nova-compute[72426]:       <nova:ports>
Aug 01 08:17:41 user nova-compute[72426]:         <nova:port uuid="4f7d2fe1-5bf7-4270-a15a-11c145726e16">
Aug 01 08:17:41 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 08:17:41 user nova-compute[72426]:         </nova:port>
Aug 01 08:17:41 user nova-compute[72426]:       </nova:ports>
Aug 01 08:17:41 user nova-compute[72426]:     </nova:instance>
Aug 01 08:17:41 user nova-compute[72426]:   </metadata>
Aug 01 08:17:41 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:17:41 user nova-compute[72426]:     <system>
Aug 01 08:17:41 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:17:41 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:17:41 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:17:41 user nova-compute[72426]:       <entry name="serial">2572e472-73fe-4e5a-b486-e38274a978d7</entry>
Aug 01 08:17:41 user nova-compute[72426]:       <entry name="uuid">2572e472-73fe-4e5a-b486-e38274a978d7</entry>
Aug 01 08:17:41 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:17:41 user nova-compute[72426]:     </system>
Aug 01 08:17:41 user nova-compute[72426]:   </sysinfo>
Aug 01 08:17:41 user nova-compute[72426]:   <os>
Aug 01 08:17:41 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:17:41 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:17:41 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:17:41 user nova-compute[72426]:   </os>
Aug 01 08:17:41 user nova-compute[72426]:   <features>
Aug 01 08:17:41 user nova-compute[72426]:     <acpi/>
Aug 01 08:17:41 user nova-compute[72426]:     <apic/>
Aug 01 08:17:41 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:17:41 user nova-compute[72426]:   </features>
Aug 01 08:17:41 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:17:41 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:17:41 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:17:41 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:17:41 user nova-compute[72426]:   </clock>
Aug 01 08:17:41 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:17:41 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:17:41 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:17:41 user nova-compute[72426]:   </cpu>
Aug 01 08:17:41 user nova-compute[72426]:   <devices>
Aug 01 08:17:41 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:17:41 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:17:41 user nova-compute[72426]:       <source dev="/dev/sdc"/>
Aug 01 08:17:41 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:17:41 user nova-compute[72426]:       <serial>1ba8f463-9a40-4627-bb28-92ef381bde3a</serial>
Aug 01 08:17:41 user nova-compute[72426]:     </disk>
Aug 01 08:17:41 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:17:41 user nova-compute[72426]:       <mac address="fa:16:3e:00:51:b6"/>
Aug 01 08:17:41 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:17:41 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:17:41 user nova-compute[72426]:       <target dev="tap4f7d2fe1-5b"/>
Aug 01 08:17:41 user nova-compute[72426]:     </interface>
Aug 01 08:17:41 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:17:41 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/2572e472-73fe-4e5a-b486-e38274a978d7/console.log" append="off"/>
Aug 01 08:17:41 user nova-compute[72426]:     </serial>
Aug 01 08:17:41 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:17:41 user nova-compute[72426]:     <video>
Aug 01 08:17:41 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:17:41 user nova-compute[72426]:     </video>
Aug 01 08:17:41 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:17:41 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:17:41 user nova-compute[72426]:     </rng>
Aug 01 08:17:41 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:17:41 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:17:41 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:17:41 user nova-compute[72426]:     </memballoon>
Aug 01 08:17:41 user nova-compute[72426]:   </devices>
Aug 01 08:17:41 user nova-compute[72426]: </domain>
Aug 01 08:17:41 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2008460603',display_name='tempest-ServerActionsTestOtherA-server-2008460603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2008460603',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-fivwx9jg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=2572e472-73fe-4e5a-b486-e38274a978d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG os_vif [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f7d2fe1-5b, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f7d2fe1-5b, col_values=(('external_ids', {'iface-id': '4f7d2fe1-5bf7-4270-a15a-11c145726e16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:51:b6', 'vm-uuid': '2572e472-73fe-4e5a-b486-e38274a978d7'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:41 user nova-compute[72426]: INFO os_vif [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b')
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No VIF found with MAC fa:16:3e:00:51:b6, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.network.neutron [req-285f1428-67a4-4114-a6f1-9e667db3ed35 req-3e964330-7873-4a34-b00a-0fcb79c37263 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updated VIF entry in instance network info cache for port 725650f1-c621-47c2-bb87-a85d41c698d3. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG nova.network.neutron [req-285f1428-67a4-4114-a6f1-9e667db3ed35 req-3e964330-7873-4a34-b00a-0fcb79c37263 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updating instance_info_cache with network_info: [{"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-285f1428-67a4-4114-a6f1-9e667db3ed35 req-3e964330-7873-4a34-b00a-0fcb79c37263 service nova] Releasing lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:17:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:17:43 user nova-compute[72426]: INFO nova.compute.claims [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Claim successful on node user
Aug 01 08:17:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-403ae3ce-07aa-4564-a305-1c470dc50fa8 req-a5a9933b-c8c1-48f8-823a-fc69031fb298 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-403ae3ce-07aa-4564-a305-1c470dc50fa8 req-a5a9933b-c8c1-48f8-823a-fc69031fb298 service nova] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-403ae3ce-07aa-4564-a305-1c470dc50fa8 req-a5a9933b-c8c1-48f8-823a-fc69031fb298 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-403ae3ce-07aa-4564-a305-1c470dc50fa8 req-a5a9933b-c8c1-48f8-823a-fc69031fb298 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-403ae3ce-07aa-4564-a305-1c470dc50fa8 req-a5a9933b-c8c1-48f8-823a-fc69031fb298 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] No waiting events found dispatching network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:43 user nova-compute[72426]: WARNING nova.compute.manager [req-403ae3ce-07aa-4564-a305-1c470dc50fa8 req-a5a9933b-c8c1-48f8-823a-fc69031fb298 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received unexpected event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 for instance with vm_state building and task_state spawning.
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877848.4776676, dad9feb1-d5fa-4ed2-9fe3-1573010446f6 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:43 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] VM Stopped (Lifecycle Event)
Aug 01 08:17:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-912b4be5-78d3-4456-ad19-f28de58fe57e None None] [instance: dad9feb1-d5fa-4ed2-9fe3-1573010446f6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:17:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-5070931b-d6bc-4694-af21-484130767262 req-d81124fb-efbb-4baf-bcce-780d7cf8a8e6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5070931b-d6bc-4694-af21-484130767262 req-d81124fb-efbb-4baf-bcce-780d7cf8a8e6 service nova] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5070931b-d6bc-4694-af21-484130767262 req-d81124fb-efbb-4baf-bcce-780d7cf8a8e6 service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5070931b-d6bc-4694-af21-484130767262 req-d81124fb-efbb-4baf-bcce-780d7cf8a8e6 service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-5070931b-d6bc-4694-af21-484130767262 req-d81124fb-efbb-4baf-bcce-780d7cf8a8e6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] No waiting events found dispatching network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:43 user nova-compute[72426]: WARNING nova.compute.manager [req-5070931b-d6bc-4694-af21-484130767262 req-d81124fb-efbb-4baf-bcce-780d7cf8a8e6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received unexpected event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 for instance with vm_state building and task_state spawning.
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.policy [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aab05095eb5347ea9f7e4f7bf33a089a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d025ba4c824773bbeedb7981910a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:17:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Creating image(s)
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "/opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "/opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.156s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk 1073741824" returned: 0 in 0.055s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.169s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Cannot resize image /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG nova.objects.instance [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'migration_context' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG nova.network.neutron [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Successfully created port: 9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Ensure instance console log exists: /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Successfully updated port: 9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquired lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] No waiting events found dispatching network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:45 user nova-compute[72426]: WARNING nova.compute.manager [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received unexpected event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 for instance with vm_state building and task_state spawning.
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-changed-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Refreshing instance network info cache due to event network-changed-9f0b410f-c412-4817-9db3-b9ec5ffe8c09. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] Acquiring lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Updating instance_info_cache with network_info: [{"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Releasing lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance network_info: |[{"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] Acquired lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.network.neutron [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Refreshing network info cache for port 9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Start _get_guest_xml network_info=[{"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:17:45 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:17:45 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-786606183',display_name='tempest-AttachVolumeTestJSON-server-786606183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-786606183',id=27,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhMcMLFpWRtcugrzk5/raTjStSXB9ipq79Xl+iZRLvhAJzQsUrNTa4A33Y+LFLAJhexCpWGTXgzOp8ywgg15r2gAc8AxCfNY7zz3j9aWRNC0qS56zJkCjoe3hYKglRjfQ==',key_name='tempest-keypair-1553423732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-rcziynoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=e1119088-18c7-483d-a89d-3b5d19054e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.objects.instance [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'pci_devices' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:17:45 user nova-compute[72426]:   <uuid>e1119088-18c7-483d-a89d-3b5d19054e52</uuid>
Aug 01 08:17:45 user nova-compute[72426]:   <name>instance-0000001b</name>
Aug 01 08:17:45 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:17:45 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:17:45 user nova-compute[72426]:   <metadata>
Aug 01 08:17:45 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:17:45 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:17:45 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeTestJSON-server-786606183</nova:name>
Aug 01 08:17:45 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:17:45</nova:creationTime>
Aug 01 08:17:45 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:17:45 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:17:45 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:17:45 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:17:45 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:17:45 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:17:45 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:17:45 user nova-compute[72426]:       <nova:owner>
Aug 01 08:17:45 user nova-compute[72426]:         <nova:user uuid="aab05095eb5347ea9f7e4f7bf33a089a">tempest-AttachVolumeTestJSON-173754033-project-member</nova:user>
Aug 01 08:17:45 user nova-compute[72426]:         <nova:project uuid="f4d025ba4c824773bbeedb7981910a9a">tempest-AttachVolumeTestJSON-173754033</nova:project>
Aug 01 08:17:45 user nova-compute[72426]:       </nova:owner>
Aug 01 08:17:45 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:17:45 user nova-compute[72426]:       <nova:ports>
Aug 01 08:17:45 user nova-compute[72426]:         <nova:port uuid="9f0b410f-c412-4817-9db3-b9ec5ffe8c09">
Aug 01 08:17:45 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 08:17:45 user nova-compute[72426]:         </nova:port>
Aug 01 08:17:45 user nova-compute[72426]:       </nova:ports>
Aug 01 08:17:45 user nova-compute[72426]:     </nova:instance>
Aug 01 08:17:45 user nova-compute[72426]:   </metadata>
Aug 01 08:17:45 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:17:45 user nova-compute[72426]:     <system>
Aug 01 08:17:45 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:17:45 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:17:45 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:17:45 user nova-compute[72426]:       <entry name="serial">e1119088-18c7-483d-a89d-3b5d19054e52</entry>
Aug 01 08:17:45 user nova-compute[72426]:       <entry name="uuid">e1119088-18c7-483d-a89d-3b5d19054e52</entry>
Aug 01 08:17:45 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:17:45 user nova-compute[72426]:     </system>
Aug 01 08:17:45 user nova-compute[72426]:   </sysinfo>
Aug 01 08:17:45 user nova-compute[72426]:   <os>
Aug 01 08:17:45 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:17:45 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:17:45 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:17:45 user nova-compute[72426]:   </os>
Aug 01 08:17:45 user nova-compute[72426]:   <features>
Aug 01 08:17:45 user nova-compute[72426]:     <acpi/>
Aug 01 08:17:45 user nova-compute[72426]:     <apic/>
Aug 01 08:17:45 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:17:45 user nova-compute[72426]:   </features>
Aug 01 08:17:45 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:17:45 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:17:45 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:17:45 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:17:45 user nova-compute[72426]:   </clock>
Aug 01 08:17:45 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:17:45 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:17:45 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:17:45 user nova-compute[72426]:   </cpu>
Aug 01 08:17:45 user nova-compute[72426]:   <devices>
Aug 01 08:17:45 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:17:45 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:17:45 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk"/>
Aug 01 08:17:45 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:17:45 user nova-compute[72426]:     </disk>
Aug 01 08:17:45 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:17:45 user nova-compute[72426]:       <mac address="fa:16:3e:d4:cf:4b"/>
Aug 01 08:17:45 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:17:45 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:17:45 user nova-compute[72426]:       <target dev="tap9f0b410f-c4"/>
Aug 01 08:17:45 user nova-compute[72426]:     </interface>
Aug 01 08:17:45 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:17:45 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/console.log" append="off"/>
Aug 01 08:17:45 user nova-compute[72426]:     </serial>
Aug 01 08:17:45 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:17:45 user nova-compute[72426]:     <video>
Aug 01 08:17:45 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:17:45 user nova-compute[72426]:     </video>
Aug 01 08:17:45 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:17:45 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:17:45 user nova-compute[72426]:     </rng>
Aug 01 08:17:45 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:17:45 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:17:45 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:17:45 user nova-compute[72426]:     </memballoon>
Aug 01 08:17:45 user nova-compute[72426]:   </devices>
Aug 01 08:17:45 user nova-compute[72426]: </domain>
Aug 01 08:17:45 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-786606183',display_name='tempest-AttachVolumeTestJSON-server-786606183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-786606183',id=27,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhMcMLFpWRtcugrzk5/raTjStSXB9ipq79Xl+iZRLvhAJzQsUrNTa4A33Y+LFLAJhexCpWGTXgzOp8ywgg15r2gAc8AxCfNY7zz3j9aWRNC0qS56zJkCjoe3hYKglRjfQ==',key_name='tempest-keypair-1553423732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-rcziynoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=e1119088-18c7-483d-a89d-3b5d19054e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG os_vif [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f0b410f-c4, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f0b410f-c4, col_values=(('external_ids', {'iface-id': '9f0b410f-c412-4817-9db3-b9ec5ffe8c09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:cf:4b', 'vm-uuid': 'e1119088-18c7-483d-a89d-3b5d19054e52'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:45 user nova-compute[72426]: INFO os_vif [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4')
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-0c123619-312d-4c36-ba53-db19a24c7c54 req-cf8f83aa-6948-48fd-9f13-6e436e7a26a6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0c123619-312d-4c36-ba53-db19a24c7c54 req-cf8f83aa-6948-48fd-9f13-6e436e7a26a6 service nova] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0c123619-312d-4c36-ba53-db19a24c7c54 req-cf8f83aa-6948-48fd-9f13-6e436e7a26a6 service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0c123619-312d-4c36-ba53-db19a24c7c54 req-cf8f83aa-6948-48fd-9f13-6e436e7a26a6 service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-0c123619-312d-4c36-ba53-db19a24c7c54 req-cf8f83aa-6948-48fd-9f13-6e436e7a26a6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] No waiting events found dispatching network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:45 user nova-compute[72426]: WARNING nova.compute.manager [req-0c123619-312d-4c36-ba53-db19a24c7c54 req-cf8f83aa-6948-48fd-9f13-6e436e7a26a6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received unexpected event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 for instance with vm_state building and task_state spawning.
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:17:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No VIF found with MAC fa:16:3e:d4:cf:4b, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877865.9991739, adcf2dea-a758-4e13-9091-fffa6339f670 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] VM Resumed (Lifecycle Event)
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Instance spawned successfully.
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Instance spawned successfully.
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877866.0005152, adcf2dea-a758-4e13-9091-fffa6339f670 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] VM Started (Lifecycle Event)
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877866.0058622, 2572e472-73fe-4e5a-b486-e38274a978d7 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] VM Resumed (Lifecycle Event)
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Took 8.69 seconds to spawn the instance on the hypervisor.
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877866.0068214, 2572e472-73fe-4e5a-b486-e38274a978d7 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] VM Started (Lifecycle Event)
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.network.neutron [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Updated VIF entry in instance network info cache for port 9f0b410f-c412-4817-9db3-b9ec5ffe8c09. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.network.neutron [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Updating instance_info_cache with network_info: [{"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f28eb97e-6475-486a-b6bc-63f98affe9b4 req-18f8e3ce-b525-4335-a24e-ba39b511be22 service nova] Releasing lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Took 9.61 seconds to build instance.
Aug 01 08:17:46 user nova-compute[72426]: INFO nova.compute.manager [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Took 16.83 seconds to build instance.
Aug 01 08:17:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4b2ee510-dde9-45e4-b81e-a298ad8fa8a0 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.721s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-03061e2c-5887-4f47-9ad9-45b7bb0d3984 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "2572e472-73fe-4e5a-b486-e38274a978d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.944s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-51da8588-89ed-4a8f-85b3-306f82a3b85f req-a4137c4f-891f-446a-924c-51a40caa7d16 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-51da8588-89ed-4a8f-85b3-306f82a3b85f req-a4137c4f-891f-446a-924c-51a40caa7d16 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-51da8588-89ed-4a8f-85b3-306f82a3b85f req-a4137c4f-891f-446a-924c-51a40caa7d16 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-51da8588-89ed-4a8f-85b3-306f82a3b85f req-a4137c4f-891f-446a-924c-51a40caa7d16 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-51da8588-89ed-4a8f-85b3-306f82a3b85f req-a4137c4f-891f-446a-924c-51a40caa7d16 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:48 user nova-compute[72426]: WARNING nova.compute.manager [req-51da8588-89ed-4a8f-85b3-306f82a3b85f req-a4137c4f-891f-446a-924c-51a40caa7d16 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state building and task_state spawning.
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877869.5393696, e1119088-18c7-483d-a89d-3b5d19054e52 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] VM Resumed (Lifecycle Event)
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:17:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance spawned successfully.
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:17:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877869.5404744, e1119088-18c7-483d-a89d-3b5d19054e52 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:17:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] VM Started (Lifecycle Event)
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:17:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:17:49 user nova-compute[72426]: INFO nova.compute.manager [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 01 08:17:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:17:49 user nova-compute[72426]: INFO nova.compute.manager [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Took 6.77 seconds to build instance.
Aug 01 08:17:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-92affb85-e438-408f-aae1-fa2ada4b994f tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.908s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-259470b6-6c8d-4afb-8c32-224ff08d5f85 req-8eeb2d59-fb0f-4dd9-8b55-fa271d76625c service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:17:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-259470b6-6c8d-4afb-8c32-224ff08d5f85 req-8eeb2d59-fb0f-4dd9-8b55-fa271d76625c service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:17:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-259470b6-6c8d-4afb-8c32-224ff08d5f85 req-8eeb2d59-fb0f-4dd9-8b55-fa271d76625c service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:17:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-259470b6-6c8d-4afb-8c32-224ff08d5f85 req-8eeb2d59-fb0f-4dd9-8b55-fa271d76625c service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:17:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-259470b6-6c8d-4afb-8c32-224ff08d5f85 req-8eeb2d59-fb0f-4dd9-8b55-fa271d76625c service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:17:50 user nova-compute[72426]: WARNING nova.compute.manager [req-259470b6-6c8d-4afb-8c32-224ff08d5f85 req-8eeb2d59-fb0f-4dd9-8b55-fa271d76625c service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state active and task_state None.
Aug 01 08:17:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:17:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:18:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:18:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72426) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 08:18:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:18:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:18:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-825be5af-e5bc-4ebc-87b5-c9aefbe6db73 req-5caa39e7-6d72-4a32-8956-e7664faa90fa service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received event network-changed-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-825be5af-e5bc-4ebc-87b5-c9aefbe6db73 req-5caa39e7-6d72-4a32-8956-e7664faa90fa service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Refreshing instance network info cache due to event network-changed-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:18:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-825be5af-e5bc-4ebc-87b5-c9aefbe6db73 req-5caa39e7-6d72-4a32-8956-e7664faa90fa service nova] Acquiring lock "refresh_cache-0acb6dc3-765c-44fb-a06b-a30e5e6948f3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:18:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-825be5af-e5bc-4ebc-87b5-c9aefbe6db73 req-5caa39e7-6d72-4a32-8956-e7664faa90fa service nova] Acquired lock "refresh_cache-0acb6dc3-765c-44fb-a06b-a30e5e6948f3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:18:18 user nova-compute[72426]: DEBUG nova.network.neutron [req-825be5af-e5bc-4ebc-87b5-c9aefbe6db73 req-5caa39e7-6d72-4a32-8956-e7664faa90fa service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Refreshing network info cache for port b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG nova.network.neutron [req-825be5af-e5bc-4ebc-87b5-c9aefbe6db73 req-5caa39e7-6d72-4a32-8956-e7664faa90fa service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Updated VIF entry in instance network info cache for port b1bf14a4-3514-48fd-84f4-fdd78ebc5df1. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG nova.network.neutron [req-825be5af-e5bc-4ebc-87b5-c9aefbe6db73 req-5caa39e7-6d72-4a32-8956-e7664faa90fa service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Updating instance_info_cache with network_info: [{"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-825be5af-e5bc-4ebc-87b5-c9aefbe6db73 req-5caa39e7-6d72-4a32-8956-e7664faa90fa service nova] Releasing lock "refresh_cache-0acb6dc3-765c-44fb-a06b-a30e5e6948f3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "2236c44a-562a-4b67-a487-ad51180dbaa0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:19 user nova-compute[72426]: INFO nova.compute.manager [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Terminating instance
Aug 01 08:18:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG nova.compute.manager [req-c891eac6-031d-49fe-b052-e7ebffdb6779 req-438add3f-3c7f-4f02-9fd1-df7fdce38b7c service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received event network-vif-unplugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c891eac6-031d-49fe-b052-e7ebffdb6779 req-438add3f-3c7f-4f02-9fd1-df7fdce38b7c service nova] Acquiring lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c891eac6-031d-49fe-b052-e7ebffdb6779 req-438add3f-3c7f-4f02-9fd1-df7fdce38b7c service nova] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c891eac6-031d-49fe-b052-e7ebffdb6779 req-438add3f-3c7f-4f02-9fd1-df7fdce38b7c service nova] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG nova.compute.manager [req-c891eac6-031d-49fe-b052-e7ebffdb6779 req-438add3f-3c7f-4f02-9fd1-df7fdce38b7c service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] No waiting events found dispatching network-vif-unplugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:19 user nova-compute[72426]: DEBUG nova.compute.manager [req-c891eac6-031d-49fe-b052-e7ebffdb6779 req-438add3f-3c7f-4f02-9fd1-df7fdce38b7c service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received event network-vif-unplugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:20 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Instance destroyed successfully.
Aug 01 08:18:20 user nova-compute[72426]: DEBUG nova.objects.instance [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lazy-loading 'resources' on Instance uuid 2236c44a-562a-4b67-a487-ad51180dbaa0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-341757131',display_name='tempest-TestVolumeBootPattern-volume-backed-server-341757131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-341757131',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMGZaN1lEFO6+rTNjzYnu6rCae9yCftdCKtYwzyd9FepVghLyLJYRUTnmRrxttix1Ja0VLEB5bTGBxv05NQ4g4oZNP2fJrAf4C6Ll7BeT6s5F2ME6+PgvJgPN5A2X5usQ==',key_name='tempest-keypair-858649081',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-rtxswdf1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=2236c44a-562a-4b67-a487-ad51180dbaa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "address": "fa:16:3e:0f:b1:42", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf6e4e5a-78", "ovs_interfaceid": "af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6e4e5a-78') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_vif [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6e4e5a-78') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf6e4e5a-78, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:18:20 user nova-compute[72426]: INFO os_vif [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:b1:42,bridge_name='br-int',has_traffic_filtering=True,id=af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf6e4e5a-78')
Aug 01 08:18:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WexjNtdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:18:20 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dfe4b4-0f28-4fa9-b48d-9ab5b32fbbd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b422c105-fe65-4017-9963-511b558321d9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:18:20 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:18:20 user nova-compute[72426]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:18:20 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:18:20 user nova-compute[72426]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 (non-flash)
Aug 01 08:18:20 user nova-compute[72426]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:18:20 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38fe1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4'): ({'sde'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Removing single pathed devices sde {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa50619-421f-482f-a5b9-e4b3aeea05ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[265ebe1a-68d1-4f29-aebb-70fa6687faf1]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flushing IO for device /dev/sde {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d60ad88-05ca-454e-807f-f40bf7e85d31]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eba71ab-ced5-4fd5-ba6a-2e06d6785445]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] SCSI volumes sde have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf351ee1-6bfe-456d-9b16-34b67d937342]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f926d-b0a0-4358-abd5-b3fffcbc4bbd]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4, portal: 172.16.0.220,3260]
Aug 01 08:18:20 user nova-compute[72426]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4, portal: 172.16.0.220,3260] successful.
Aug 01 08:18:20 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7f2fb7-3db8-441c-820e-774209ec96d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f0fefd-59be-49df-b950-643357b70c6d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== disconnect_volume: return (298ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:18:20 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Deleting instance files /opt/stack/data/nova/instances/2236c44a-562a-4b67-a487-ad51180dbaa0_del
Aug 01 08:18:20 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Deletion of /opt/stack/data/nova/instances/2236c44a-562a-4b67-a487-ad51180dbaa0_del complete
Aug 01 08:18:20 user nova-compute[72426]: INFO nova.compute.manager [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Took 1.46 seconds to destroy the instance on the hypervisor.
Aug 01 08:18:20 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:18:20 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:18:21 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:21 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Took 1.30 seconds to deallocate network for instance.
Aug 01 08:18:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-aa6a5c07-0c1e-43a4-bc46-d618518bb310 req-954a531e-01e7-4016-94a0-39e2b51a9e93 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received event network-vif-deleted-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:21 user nova-compute[72426]: INFO nova.compute.manager [req-aa6a5c07-0c1e-43a4-bc46-d618518bb310 req-954a531e-01e7-4016-94a0-39e2b51a9e93 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Neutron deleted interface af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9; detaching it from the instance and deleting it from the info cache
Aug 01 08:18:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-aa6a5c07-0c1e-43a4-bc46-d618518bb310 req-954a531e-01e7-4016-94a0-39e2b51a9e93 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-aa6a5c07-0c1e-43a4-bc46-d618518bb310 req-954a531e-01e7-4016-94a0-39e2b51a9e93 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Detach interface failed, port_id=af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9, reason: Instance 2236c44a-562a-4b67-a487-ad51180dbaa0 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:18:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-df52b413-9b58-45e8-a2e8-ace03436b45a req-e633fd58-11c7-472e-89a1-433509a6f6b9 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received event network-vif-plugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-df52b413-9b58-45e8-a2e8-ace03436b45a req-e633fd58-11c7-472e-89a1-433509a6f6b9 service nova] Acquiring lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-df52b413-9b58-45e8-a2e8-ace03436b45a req-e633fd58-11c7-472e-89a1-433509a6f6b9 service nova] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-df52b413-9b58-45e8-a2e8-ace03436b45a req-e633fd58-11c7-472e-89a1-433509a6f6b9 service nova] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-df52b413-9b58-45e8-a2e8-ace03436b45a req-e633fd58-11c7-472e-89a1-433509a6f6b9 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] No waiting events found dispatching network-vif-plugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:21 user nova-compute[72426]: WARNING nova.compute.manager [req-df52b413-9b58-45e8-a2e8-ace03436b45a req-e633fd58-11c7-472e-89a1-433509a6f6b9 service nova] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Received unexpected event network-vif-plugged-af6e4e5a-782c-4fd5-a85b-7a5825e9f5c9 for instance with vm_state active and task_state deleting.
Aug 01 08:18:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:26 user nova-compute[72426]: INFO nova.compute.manager [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Took 4.84 seconds to detach 1 volumes for instance.
Aug 01 08:18:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Deleting volume: ea7f2fb7-3db8-441c-820e-774209ec96d4 {{(pid=72426) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.552s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:27 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Deleted allocations for instance 2236c44a-562a-4b67-a487-ad51180dbaa0
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-46de1aaf-9315-4d99-b96f-29feb773d326 tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "2236c44a-562a-4b67-a487-ad51180dbaa0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.511s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:28 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:18:28 user nova-compute[72426]: INFO nova.compute.claims [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Claim successful on node user
Aug 01 08:18:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:18:29 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:18:29 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:18:29 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7116MB free_disk=25.49868392944336GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:18:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:29 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:18:29 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:18:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.952s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:18:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.402s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:18:30 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 73fb06b8-0824-42fc-bbfd-6914bdb78824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2572e472-73fe-4e5a-b486-e38274a978d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance adcf2dea-a758-4e13-9091-fffa6339f670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance e1119088-18c7-483d-a89d-3b5d19054e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 711f36c5-6692-4aec-b4fe-0aac97dfef12 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:18:30 user nova-compute[72426]: INFO nova.compute.manager [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Rescuing
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquired lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:18:30 user nova-compute[72426]: INFO nova.virt.block_device [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Booting with volume b265c54d-477a-4089-a4e6-78d137658f21 at /dev/vda
Aug 01 08:18:30 user nova-compute[72426]: DEBUG os_brick.utils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.policy [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c3b164242dc4336889758526ddabd74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be045e22d244d6984b171cd0345b6ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.041s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca509ea-e45e-4b17-8016-a22c931286df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef701585-8d0b-4825-bb20-e0343e231c6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2a6873-1ca2-42a0-9c84-d26dbad18381]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[62990fc9-278f-4b8d-bdee-50436b6dbd39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:18:30 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb5ea81-30ff-4817-b928-728429becbbe]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG os_brick.utils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Updating existing volume attachment record: 18a0fa88-be8a-4278-b72a-c7d410361b72 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:18:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG nova.network.neutron [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updating instance_info_cache with network_info: [{"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Releasing lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG nova.compute.manager [req-5eefba53-6c5d-486d-b114-e7361f699a88 req-d4d3e00b-cbdb-4772-9fd1-9e773971642b service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5eefba53-6c5d-486d-b114-e7361f699a88 req-d4d3e00b-cbdb-4772-9fd1-9e773971642b service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5eefba53-6c5d-486d-b114-e7361f699a88 req-d4d3e00b-cbdb-4772-9fd1-9e773971642b service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5eefba53-6c5d-486d-b114-e7361f699a88 req-d4d3e00b-cbdb-4772-9fd1-9e773971642b service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG nova.compute.manager [req-5eefba53-6c5d-486d-b114-e7361f699a88 req-d4d3e00b-cbdb-4772-9fd1-9e773971642b service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:31 user nova-compute[72426]: WARNING nova.compute.manager [req-5eefba53-6c5d-486d-b114-e7361f699a88 req-d4d3e00b-cbdb-4772-9fd1-9e773971642b service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state active and task_state rescuing.
Aug 01 08:18:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:31 user nova-compute[72426]: DEBUG nova.network.neutron [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Successfully created port: e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:32 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Instance destroyed successfully.
Aug 01 08:18:32 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Attempting rescue
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72426) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Instance directory exists: not creating {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 08:18:32 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Creating image(s)
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'trusted_certs' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.175s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.rescue {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.rescue" returned: 0 in 0.083s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'migration_context' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Start _get_guest_xml network_info=[{"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "vif_mac": "fa:16:3e:24:e2:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'resources' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'numa_topology' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:32 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:18:32 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'vcpu_model' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-606882209',display_name='tempest-ServerRescueNegativeTestJSON-server-606882209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-606882209',id=18,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-u9xaq11k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:13:54Z,user_data=None,user_id='e024ff90ae7148819d1d518d3754733f',uuid=a48d957c-264f-4d4f-a3b7-54e287f606dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "vif_mac": "fa:16:3e:24:e2:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "vif_mac": "fa:16:3e:24:e2:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:e2:c7,bridge_name='br-int',has_traffic_filtering=True,id=2b6e1a0b-eb3e-4071-80a3-227777cfa5d7,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e1a0b-eb') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'pci_devices' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:18:32 user nova-compute[72426]:   <uuid>a48d957c-264f-4d4f-a3b7-54e287f606dd</uuid>
Aug 01 08:18:32 user nova-compute[72426]:   <name>instance-00000012</name>
Aug 01 08:18:32 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:18:32 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:18:32 user nova-compute[72426]:   <metadata>
Aug 01 08:18:32 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:18:32 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:18:32 user nova-compute[72426]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-606882209</nova:name>
Aug 01 08:18:32 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:18:32</nova:creationTime>
Aug 01 08:18:32 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:18:32 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:18:32 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:18:32 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:18:32 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:18:32 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:18:32 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:18:32 user nova-compute[72426]:       <nova:owner>
Aug 01 08:18:32 user nova-compute[72426]:         <nova:user uuid="e024ff90ae7148819d1d518d3754733f">tempest-ServerRescueNegativeTestJSON-1267015268-project-member</nova:user>
Aug 01 08:18:32 user nova-compute[72426]:         <nova:project uuid="ba9024541f804b259eeed3f2dd0ce12f">tempest-ServerRescueNegativeTestJSON-1267015268</nova:project>
Aug 01 08:18:32 user nova-compute[72426]:       </nova:owner>
Aug 01 08:18:32 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:18:32 user nova-compute[72426]:       <nova:ports>
Aug 01 08:18:32 user nova-compute[72426]:         <nova:port uuid="2b6e1a0b-eb3e-4071-80a3-227777cfa5d7">
Aug 01 08:18:32 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 08:18:32 user nova-compute[72426]:         </nova:port>
Aug 01 08:18:32 user nova-compute[72426]:       </nova:ports>
Aug 01 08:18:32 user nova-compute[72426]:     </nova:instance>
Aug 01 08:18:32 user nova-compute[72426]:   </metadata>
Aug 01 08:18:32 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:18:32 user nova-compute[72426]:     <system>
Aug 01 08:18:32 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:18:32 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:18:32 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:18:32 user nova-compute[72426]:       <entry name="serial">a48d957c-264f-4d4f-a3b7-54e287f606dd</entry>
Aug 01 08:18:32 user nova-compute[72426]:       <entry name="uuid">a48d957c-264f-4d4f-a3b7-54e287f606dd</entry>
Aug 01 08:18:32 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:18:32 user nova-compute[72426]:     </system>
Aug 01 08:18:32 user nova-compute[72426]:   </sysinfo>
Aug 01 08:18:32 user nova-compute[72426]:   <os>
Aug 01 08:18:32 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:18:32 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:18:32 user nova-compute[72426]:   </os>
Aug 01 08:18:32 user nova-compute[72426]:   <features>
Aug 01 08:18:32 user nova-compute[72426]:     <acpi/>
Aug 01 08:18:32 user nova-compute[72426]:     <apic/>
Aug 01 08:18:32 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:18:32 user nova-compute[72426]:   </features>
Aug 01 08:18:32 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:18:32 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:18:32 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:18:32 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:18:32 user nova-compute[72426]:   </clock>
Aug 01 08:18:32 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:18:32 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:18:32 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:18:32 user nova-compute[72426]:   </cpu>
Aug 01 08:18:32 user nova-compute[72426]:   <devices>
Aug 01 08:18:32 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:18:32 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:18:32 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.rescue"/>
Aug 01 08:18:32 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:18:32 user nova-compute[72426]:     </disk>
Aug 01 08:18:32 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:18:32 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:18:32 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk"/>
Aug 01 08:18:32 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:18:32 user nova-compute[72426]:     </disk>
Aug 01 08:18:32 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:18:32 user nova-compute[72426]:       <mac address="fa:16:3e:24:e2:c7"/>
Aug 01 08:18:32 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:18:32 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:18:32 user nova-compute[72426]:       <target dev="tap2b6e1a0b-eb"/>
Aug 01 08:18:32 user nova-compute[72426]:     </interface>
Aug 01 08:18:32 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:18:32 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/console.log" append="off"/>
Aug 01 08:18:32 user nova-compute[72426]:     </serial>
Aug 01 08:18:32 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:18:32 user nova-compute[72426]:     <video>
Aug 01 08:18:32 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:18:32 user nova-compute[72426]:     </video>
Aug 01 08:18:32 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:18:32 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:18:32 user nova-compute[72426]:     </rng>
Aug 01 08:18:32 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:18:32 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:18:32 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:18:32 user nova-compute[72426]:     </memballoon>
Aug 01 08:18:32 user nova-compute[72426]:   </devices>
Aug 01 08:18:32 user nova-compute[72426]: </domain>
Aug 01 08:18:32 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:18:32 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Instance destroyed successfully.
Aug 01 08:18:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:18:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No VIF found with MAC fa:16:3e:24:e2:c7, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:33 user nova-compute[72426]: WARNING nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state active and task_state rescuing.
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:33 user nova-compute[72426]: WARNING nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state active and task_state rescuing.
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:33 user nova-compute[72426]: WARNING nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state active and task_state rescuing.
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:33 user nova-compute[72426]: WARNING nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state active and task_state rescuing.
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:33 user nova-compute[72426]: WARNING nova.compute.manager [req-6a113b25-26cd-4d12-b957-d0c10b6d474a req-c522c37d-43d9-4478-ad4d-140ca2111afe service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state active and task_state rescuing.
Aug 01 08:18:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Successfully updated port: e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "refresh_cache-711f36c5-6692-4aec-b4fe-0aac97dfef12" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquired lock "refresh_cache-711f36c5-6692-4aec-b4fe-0aac97dfef12" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updating instance_info_cache with network_info: [{"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-469fab53-f20c-40c0-bc3d-682941c4548c req-19527017-166b-4d00-a7d3-b0998b4518f4 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-changed-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-469fab53-f20c-40c0-bc3d-682941c4548c req-19527017-166b-4d00-a7d3-b0998b4518f4 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Refreshing instance network info cache due to event network-changed-e77776de-abb0-4125-bb7d-69f76d60d9f6. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-469fab53-f20c-40c0-bc3d-682941c4548c req-19527017-166b-4d00-a7d3-b0998b4518f4 service nova] Acquiring lock "refresh_cache-711f36c5-6692-4aec-b4fe-0aac97dfef12" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Updating instance_info_cache with network_info: [{"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Releasing lock "refresh_cache-711f36c5-6692-4aec-b4fe-0aac97dfef12" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Instance network_info: |[{"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-469fab53-f20c-40c0-bc3d-682941c4548c req-19527017-166b-4d00-a7d3-b0998b4518f4 service nova] Acquired lock "refresh_cache-711f36c5-6692-4aec-b4fe-0aac97dfef12" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:18:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-469fab53-f20c-40c0-bc3d-682941c4548c req-19527017-166b-4d00-a7d3-b0998b4518f4 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Refreshing network info cache for port e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877900.1573524, 2236c44a-562a-4b67-a487-ad51180dbaa0 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:18:35 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] VM Stopped (Lifecycle Event)
Aug 01 08:18:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6b5a148c-bb6d-40ff-ba3a-4065ef66c4b8 None None] [instance: 2236c44a-562a-4b67-a487-ad51180dbaa0] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-469fab53-f20c-40c0-bc3d-682941c4548c req-19527017-166b-4d00-a7d3-b0998b4518f4 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Updated VIF entry in instance network info cache for port e77776de-abb0-4125-bb7d-69f76d60d9f6. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-469fab53-f20c-40c0-bc3d-682941c4548c req-19527017-166b-4d00-a7d3-b0998b4518f4 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Updating instance_info_cache with network_info: [{"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-469fab53-f20c-40c0-bc3d-682941c4548c req-19527017-166b-4d00-a7d3-b0998b4518f4 service nova] Releasing lock "refresh_cache-711f36c5-6692-4aec-b4fe-0aac97dfef12" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:35 user nova-compute[72426]: WARNING nova.compute.manager [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state active and task_state rescuing.
Aug 01 08:18:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:35 user nova-compute[72426]: WARNING nova.compute.manager [req-0f072e8c-e92a-4da6-9c4a-d6c48da42b45 req-805420b6-253b-46e1-a8a2-5856bd2e6a4f service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state active and task_state rescuing.
Aug 01 08:18:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for a48d957c-264f-4d4f-a3b7-54e287f606dd due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:18:36 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877916.5828202, a48d957c-264f-4d4f-a3b7-54e287f606dd => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:18:36 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] VM Resumed (Lifecycle Event)
Aug 01 08:18:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-1052a166-6b3d-43c8-b683-2b9843223d21 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:18:36 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 08:18:36 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877916.5846372, a48d957c-264f-4d4f-a3b7-54e287f606dd => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:18:36 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] VM Started (Lifecycle Event)
Aug 01 08:18:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:18:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-4d9b627e-d5b4-4030-8577-4cacb6d81788 req-9aa1acc8-5aff-4270-8193-cbf04e6f1818 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-changed-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-4d9b627e-d5b4-4030-8577-4cacb6d81788 req-9aa1acc8-5aff-4270-8193-cbf04e6f1818 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Refreshing instance network info cache due to event network-changed-32122388-a2bc-410d-91f7-594b4702c6a0. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:18:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4d9b627e-d5b4-4030-8577-4cacb6d81788 req-9aa1acc8-5aff-4270-8193-cbf04e6f1818 service nova] Acquiring lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:18:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4d9b627e-d5b4-4030-8577-4cacb6d81788 req-9aa1acc8-5aff-4270-8193-cbf04e6f1818 service nova] Acquired lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:18:38 user nova-compute[72426]: DEBUG nova.network.neutron [req-4d9b627e-d5b4-4030-8577-4cacb6d81788 req-9aa1acc8-5aff-4270-8193-cbf04e6f1818 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Refreshing network info cache for port 32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:18:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:18:39 user nova-compute[72426]: DEBUG nova.network.neutron [req-4d9b627e-d5b4-4030-8577-4cacb6d81788 req-9aa1acc8-5aff-4270-8193-cbf04e6f1818 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updated VIF entry in instance network info cache for port 32122388-a2bc-410d-91f7-594b4702c6a0. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:18:39 user nova-compute[72426]: DEBUG nova.network.neutron [req-4d9b627e-d5b4-4030-8577-4cacb6d81788 req-9aa1acc8-5aff-4270-8193-cbf04e6f1818 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updating instance_info_cache with network_info: [{"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4d9b627e-d5b4-4030-8577-4cacb6d81788 req-9aa1acc8-5aff-4270-8193-cbf04e6f1818 service nova] Releasing lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:18:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:43 user nova-compute[72426]: INFO nova.compute.manager [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Shelving
Aug 01 08:18:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:18:43 user nova-compute[72426]: INFO nova.compute.claims [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Claim successful on node user
Aug 01 08:18:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-6dbe29e1-42f5-42bb-ac56-52ced5e13a49 req-74460cb6-872c-4ccd-be81-e2ba53489b6b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-unplugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6dbe29e1-42f5-42bb-ac56-52ced5e13a49 req-74460cb6-872c-4ccd-be81-e2ba53489b6b service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6dbe29e1-42f5-42bb-ac56-52ced5e13a49 req-74460cb6-872c-4ccd-be81-e2ba53489b6b service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6dbe29e1-42f5-42bb-ac56-52ced5e13a49 req-74460cb6-872c-4ccd-be81-e2ba53489b6b service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-6dbe29e1-42f5-42bb-ac56-52ced5e13a49 req-74460cb6-872c-4ccd-be81-e2ba53489b6b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-unplugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:43 user nova-compute[72426]: WARNING nova.compute.manager [req-6dbe29e1-42f5-42bb-ac56-52ced5e13a49 req-74460cb6-872c-4ccd-be81-e2ba53489b6b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received unexpected event network-vif-unplugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with vm_state active and task_state shelving.
Aug 01 08:18:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Instance destroyed successfully.
Aug 01 08:18:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Beginning cold snapshot process
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.715s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk /opt/stack/data/nova/instances/snapshots/tmpg8z65irv/b04e87205bcc49668a2904a4349585b5 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.network.neutron [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:18:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:18:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Creating image(s)
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Ensure instance console log exists: /opt/stack/data/nova/instances/711f36c5-6692-4aec-b4fe-0aac97dfef12/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Start _get_guest_xml network_info=[{"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjYNpHBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '711f36c5-6692-4aec-b4fe-0aac97dfef12', 'attached_at': '', 'detached_at': '', 'volume_id': 'b265c54d-477a-4089-a4e6-78d137658f21', 'serial': 'b265c54d-477a-4089-a4e6-78d137658f21'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '18a0fa88-be8a-4278-b72a-c7d410361b72', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:18:44 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:18:44 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjYNpHBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:18:44 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:18:44 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:18:44 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.policy [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6cd6a35cf8d4ed786314f9a680fa4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67c5b96fae746229b2f90b37110c703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe7873-34e8-48e5-84bb-fbc0be083d8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:18:44 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f6167-6c97-4c61-a048-5dbf244626df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21] added
Aug 01 08:18:44 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[69036d9d-551b-4f73-af3a-31f884179a1a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:18:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Creating image(s)
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[baec11c4-b633-43db-be48-c84643a41d13]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjYNpHBM {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjYNpHBM" returned: 0 in 0.033s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3886ec2e-f079-4c19-acb8-1815fa1ec0b5]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mjYNpHBM'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.055s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[720d8ab3-f19b-4da4-9b5f-f5ff2408ad0a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e9d2b5-6e0a-4452-afba-03921f1738b6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:18:44 user nova-compute[72426]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:18:44 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:18:44 user nova-compute[72426]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:18:44 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.164s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk /opt/stack/data/nova/instances/snapshots/tmpg8z65irv/b04e87205bcc49668a2904a4349585b5" returned: 0 in 0.696s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Snapshot extracted, beginning image upload
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.175s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk 1073741824" returned: 0 in 0.066s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.170s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Successfully created port: a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Cannot resize image /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG nova.objects.instance [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'migration_context' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Ensure instance console log exists: /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-0e62a17e-a239-497c-9f01-1396c1e27d8d req-dba652a1-0d52-433f-85aa-947377c3bb6f service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0e62a17e-a239-497c-9f01-1396c1e27d8d req-dba652a1-0d52-433f-85aa-947377c3bb6f service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0e62a17e-a239-497c-9f01-1396c1e27d8d req-dba652a1-0d52-433f-85aa-947377c3bb6f service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0e62a17e-a239-497c-9f01-1396c1e27d8d req-dba652a1-0d52-433f-85aa-947377c3bb6f service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-0e62a17e-a239-497c-9f01-1396c1e27d8d req-dba652a1-0d52-433f-85aa-947377c3bb6f service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:45 user nova-compute[72426]: WARNING nova.compute.manager [req-0e62a17e-a239-497c-9f01-1396c1e27d8d req-dba652a1-0d52-433f-85aa-947377c3bb6f service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received unexpected event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --login" returned: 0 in 1.069s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1b9cd2-7271-4fc2-a269-16bc87f07362]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260]
Aug 01 08:18:45 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260] successful.
Aug 01 08:18:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba517f68-b9e4-4898-9265-93f1afda0aea]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:18:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5686dff7-9712-41e4-8e9a-381e93108fc6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:18:46 user nova-compute[72426]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:18:46 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:18:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:18:46 user nova-compute[72426]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:18:46 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:18:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.418s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[744a86fd-33c3-4dda-a0b3-c1edbe00de62]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjYNpHBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Successfully updated port: a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquired lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updating instance_info_cache with network_info: [{"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Releasing lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Instance network_info: |[{"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Start _get_guest_xml network_info=[{"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:18:46 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:18:46 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1014751889',display_name='tempest-ServerStableDeviceRescueTest-server-1014751889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1014751889',id=29,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGOczwmFIF55GGK0yKw5W7YLyfKHgYEMleHXa1e7A8MknpSoOlTzKBkR5G0uCw9iSq/ILIoMjQkOSEKackU9urf9ByZ5uU7DY7Bf6h+tbWMKty249vXPajHXhkV+AIjA==',key_name='tempest-keypair-1725080813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c67c5b96fae746229b2f90b37110c703',ramdisk_id='',reservation_id='r-nz4656dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2126677985',owner_user_name='tempest-ServerStableDeviceRescueTest-2126677985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd6a35cf8d4ed786314f9a680fa4cc',uuid=05637642-f020-48af-b44a-d48e25a598fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Converting VIF {"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:91:18,bridge_name='br-int',has_traffic_filtering=True,id=a87f8f30-667e-4321-9d19-04f12f45eb7f,network=Network(f0be2463-2fb0-4b0c-aeb2-c36a43962363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87f8f30-66') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'pci_devices' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:18:46 user nova-compute[72426]:   <uuid>05637642-f020-48af-b44a-d48e25a598fa</uuid>
Aug 01 08:18:46 user nova-compute[72426]:   <name>instance-0000001d</name>
Aug 01 08:18:46 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:18:46 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:18:46 user nova-compute[72426]:   <metadata>
Aug 01 08:18:46 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:18:46 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:18:46 user nova-compute[72426]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1014751889</nova:name>
Aug 01 08:18:46 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:18:46</nova:creationTime>
Aug 01 08:18:46 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:18:46 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:18:46 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:18:46 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:18:46 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:18:46 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:18:46 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:18:46 user nova-compute[72426]:       <nova:owner>
Aug 01 08:18:46 user nova-compute[72426]:         <nova:user uuid="d6cd6a35cf8d4ed786314f9a680fa4cc">tempest-ServerStableDeviceRescueTest-2126677985-project-member</nova:user>
Aug 01 08:18:46 user nova-compute[72426]:         <nova:project uuid="c67c5b96fae746229b2f90b37110c703">tempest-ServerStableDeviceRescueTest-2126677985</nova:project>
Aug 01 08:18:46 user nova-compute[72426]:       </nova:owner>
Aug 01 08:18:46 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:18:46 user nova-compute[72426]:       <nova:ports>
Aug 01 08:18:46 user nova-compute[72426]:         <nova:port uuid="a87f8f30-667e-4321-9d19-04f12f45eb7f">
Aug 01 08:18:46 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 08:18:46 user nova-compute[72426]:         </nova:port>
Aug 01 08:18:46 user nova-compute[72426]:       </nova:ports>
Aug 01 08:18:46 user nova-compute[72426]:     </nova:instance>
Aug 01 08:18:46 user nova-compute[72426]:   </metadata>
Aug 01 08:18:46 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:18:46 user nova-compute[72426]:     <system>
Aug 01 08:18:46 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:18:46 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:18:46 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:18:46 user nova-compute[72426]:       <entry name="serial">05637642-f020-48af-b44a-d48e25a598fa</entry>
Aug 01 08:18:46 user nova-compute[72426]:       <entry name="uuid">05637642-f020-48af-b44a-d48e25a598fa</entry>
Aug 01 08:18:46 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:18:46 user nova-compute[72426]:     </system>
Aug 01 08:18:46 user nova-compute[72426]:   </sysinfo>
Aug 01 08:18:46 user nova-compute[72426]:   <os>
Aug 01 08:18:46 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:18:46 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:18:46 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:18:46 user nova-compute[72426]:   </os>
Aug 01 08:18:46 user nova-compute[72426]:   <features>
Aug 01 08:18:46 user nova-compute[72426]:     <acpi/>
Aug 01 08:18:46 user nova-compute[72426]:     <apic/>
Aug 01 08:18:46 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:18:46 user nova-compute[72426]:   </features>
Aug 01 08:18:46 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:18:46 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:18:46 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:18:46 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:18:46 user nova-compute[72426]:   </clock>
Aug 01 08:18:46 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:18:46 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:18:46 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:18:46 user nova-compute[72426]:   </cpu>
Aug 01 08:18:46 user nova-compute[72426]:   <devices>
Aug 01 08:18:46 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:18:46 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:18:46 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk"/>
Aug 01 08:18:46 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:18:46 user nova-compute[72426]:     </disk>
Aug 01 08:18:46 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:18:46 user nova-compute[72426]:       <mac address="fa:16:3e:eb:91:18"/>
Aug 01 08:18:46 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:18:46 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:18:46 user nova-compute[72426]:       <target dev="tapa87f8f30-66"/>
Aug 01 08:18:46 user nova-compute[72426]:     </interface>
Aug 01 08:18:46 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:18:46 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/console.log" append="off"/>
Aug 01 08:18:46 user nova-compute[72426]:     </serial>
Aug 01 08:18:46 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:18:46 user nova-compute[72426]:     <video>
Aug 01 08:18:46 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:18:46 user nova-compute[72426]:     </video>
Aug 01 08:18:46 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:18:46 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:18:46 user nova-compute[72426]:     </rng>
Aug 01 08:18:46 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:18:46 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:18:46 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:18:46 user nova-compute[72426]:     </memballoon>
Aug 01 08:18:46 user nova-compute[72426]:   </devices>
Aug 01 08:18:46 user nova-compute[72426]: </domain>
Aug 01 08:18:46 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1014751889',display_name='tempest-ServerStableDeviceRescueTest-server-1014751889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1014751889',id=29,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGOczwmFIF55GGK0yKw5W7YLyfKHgYEMleHXa1e7A8MknpSoOlTzKBkR5G0uCw9iSq/ILIoMjQkOSEKackU9urf9ByZ5uU7DY7Bf6h+tbWMKty249vXPajHXhkV+AIjA==',key_name='tempest-keypair-1725080813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c67c5b96fae746229b2f90b37110c703',ramdisk_id='',reservation_id='r-nz4656dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2126677985',owner_user_name='tempest-ServerStableDeviceRescueTest-2126677985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd6a35cf8d4ed786314f9a680fa4cc',uuid=05637642-f020-48af-b44a-d48e25a598fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Converting VIF {"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:91:18,bridge_name='br-int',has_traffic_filtering=True,id=a87f8f30-667e-4321-9d19-04f12f45eb7f,network=Network(f0be2463-2fb0-4b0c-aeb2-c36a43962363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87f8f30-66') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG os_vif [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:91:18,bridge_name='br-int',has_traffic_filtering=True,id=a87f8f30-667e-4321-9d19-04f12f45eb7f,network=Network(f0be2463-2fb0-4b0c-aeb2-c36a43962363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87f8f30-66') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa87f8f30-66, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa87f8f30-66, col_values=(('external_ids', {'iface-id': 'a87f8f30-667e-4321-9d19-04f12f45eb7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:91:18', 'vm-uuid': '05637642-f020-48af-b44a-d48e25a598fa'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:46 user nova-compute[72426]: INFO os_vif [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:91:18,bridge_name='br-int',has_traffic_filtering=True,id=a87f8f30-667e-4321-9d19-04f12f45eb7f,network=Network(f0be2463-2fb0-4b0c-aeb2-c36a43962363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87f8f30-66')
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:18:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] No VIF found with MAC fa:16:3e:eb:91:18, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.467s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] <== connect_volume: return (2468ms) {'type': 'block', 'scsi_wwn': '23335636466633966', 'path': '/dev/sdd'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335636466633966', 'path': '/dev/sdd'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-386058360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-386058360',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUuL6cIXOsVrN6GIqUyK3HSUIpRTiR6zIQsvQNqNDHMMOEkoFYsfvVw69PiuMAGsuyCOnnclpwgQI01DdYX76WXL3mjwTVlxrwB/mCjKb1sBbHecoDrcN2Zz6sELtcULg==',key_name='tempest-keypair-2041214637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7be045e22d244d6984b171cd0345b6ec',ramdisk_id='',reservation_id='r-y0xq8j4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-328470853',owner_user_name='tempest-ServerActionsV293TestJSON-328470853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:18:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3b164242dc4336889758526ddabd74',uuid=711f36c5-6692-4aec-b4fe-0aac97dfef12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converting VIF {"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'pci_devices' on Instance uuid 711f36c5-6692-4aec-b4fe-0aac97dfef12 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:18:47 user nova-compute[72426]:   <uuid>711f36c5-6692-4aec-b4fe-0aac97dfef12</uuid>
Aug 01 08:18:47 user nova-compute[72426]:   <name>instance-0000001c</name>
Aug 01 08:18:47 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:18:47 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:18:47 user nova-compute[72426]:   <metadata>
Aug 01 08:18:47 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:18:47 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:18:47 user nova-compute[72426]:       <nova:name>tempest-ServerActionsV293TestJSON-server-386058360</nova:name>
Aug 01 08:18:47 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:18:44</nova:creationTime>
Aug 01 08:18:47 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:18:47 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:18:47 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:18:47 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:18:47 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:18:47 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:18:47 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:18:47 user nova-compute[72426]:       <nova:owner>
Aug 01 08:18:47 user nova-compute[72426]:         <nova:user uuid="0c3b164242dc4336889758526ddabd74">tempest-ServerActionsV293TestJSON-328470853-project-member</nova:user>
Aug 01 08:18:47 user nova-compute[72426]:         <nova:project uuid="7be045e22d244d6984b171cd0345b6ec">tempest-ServerActionsV293TestJSON-328470853</nova:project>
Aug 01 08:18:47 user nova-compute[72426]:       </nova:owner>
Aug 01 08:18:47 user nova-compute[72426]:       <nova:ports>
Aug 01 08:18:47 user nova-compute[72426]:         <nova:port uuid="e77776de-abb0-4125-bb7d-69f76d60d9f6">
Aug 01 08:18:47 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 08:18:47 user nova-compute[72426]:         </nova:port>
Aug 01 08:18:47 user nova-compute[72426]:       </nova:ports>
Aug 01 08:18:47 user nova-compute[72426]:     </nova:instance>
Aug 01 08:18:47 user nova-compute[72426]:   </metadata>
Aug 01 08:18:47 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:18:47 user nova-compute[72426]:     <system>
Aug 01 08:18:47 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:18:47 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:18:47 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:18:47 user nova-compute[72426]:       <entry name="serial">711f36c5-6692-4aec-b4fe-0aac97dfef12</entry>
Aug 01 08:18:47 user nova-compute[72426]:       <entry name="uuid">711f36c5-6692-4aec-b4fe-0aac97dfef12</entry>
Aug 01 08:18:47 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:18:47 user nova-compute[72426]:     </system>
Aug 01 08:18:47 user nova-compute[72426]:   </sysinfo>
Aug 01 08:18:47 user nova-compute[72426]:   <os>
Aug 01 08:18:47 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:18:47 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:18:47 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:18:47 user nova-compute[72426]:   </os>
Aug 01 08:18:47 user nova-compute[72426]:   <features>
Aug 01 08:18:47 user nova-compute[72426]:     <acpi/>
Aug 01 08:18:47 user nova-compute[72426]:     <apic/>
Aug 01 08:18:47 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:18:47 user nova-compute[72426]:   </features>
Aug 01 08:18:47 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:18:47 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:18:47 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:18:47 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:18:47 user nova-compute[72426]:   </clock>
Aug 01 08:18:47 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:18:47 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:18:47 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:18:47 user nova-compute[72426]:   </cpu>
Aug 01 08:18:47 user nova-compute[72426]:   <devices>
Aug 01 08:18:47 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:18:47 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:18:47 user nova-compute[72426]:       <source dev="/dev/sdd"/>
Aug 01 08:18:47 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:18:47 user nova-compute[72426]:       <serial>b265c54d-477a-4089-a4e6-78d137658f21</serial>
Aug 01 08:18:47 user nova-compute[72426]:     </disk>
Aug 01 08:18:47 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:18:47 user nova-compute[72426]:       <mac address="fa:16:3e:e7:2b:c2"/>
Aug 01 08:18:47 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:18:47 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:18:47 user nova-compute[72426]:       <target dev="tape77776de-ab"/>
Aug 01 08:18:47 user nova-compute[72426]:     </interface>
Aug 01 08:18:47 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:18:47 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/711f36c5-6692-4aec-b4fe-0aac97dfef12/console.log" append="off"/>
Aug 01 08:18:47 user nova-compute[72426]:     </serial>
Aug 01 08:18:47 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:18:47 user nova-compute[72426]:     <video>
Aug 01 08:18:47 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:18:47 user nova-compute[72426]:     </video>
Aug 01 08:18:47 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:18:47 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:18:47 user nova-compute[72426]:     </rng>
Aug 01 08:18:47 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:18:47 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:18:47 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:18:47 user nova-compute[72426]:     </memballoon>
Aug 01 08:18:47 user nova-compute[72426]:   </devices>
Aug 01 08:18:47 user nova-compute[72426]: </domain>
Aug 01 08:18:47 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-386058360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-386058360',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUuL6cIXOsVrN6GIqUyK3HSUIpRTiR6zIQsvQNqNDHMMOEkoFYsfvVw69PiuMAGsuyCOnnclpwgQI01DdYX76WXL3mjwTVlxrwB/mCjKb1sBbHecoDrcN2Zz6sELtcULg==',key_name='tempest-keypair-2041214637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7be045e22d244d6984b171cd0345b6ec',ramdisk_id='',reservation_id='r-y0xq8j4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-328470853',owner_user_name='tempest-ServerActionsV293TestJSON-328470853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:18:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3b164242dc4336889758526ddabd74',uuid=711f36c5-6692-4aec-b4fe-0aac97dfef12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converting VIF {"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG os_vif [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape77776de-ab, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape77776de-ab, col_values=(('external_ids', {'iface-id': 'e77776de-abb0-4125-bb7d-69f76d60d9f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:2b:c2', 'vm-uuid': '711f36c5-6692-4aec-b4fe-0aac97dfef12'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:47 user nova-compute[72426]: INFO os_vif [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab')
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] No VIF found with MAC fa:16:3e:e7:2b:c2, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:18:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Snapshot image upload complete
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:47 user nova-compute[72426]: INFO nova.compute.manager [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Shelve offloading
Aug 01 08:18:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Instance destroyed successfully.
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquired lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.network.neutron [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-461a39ac-1f8a-42c4-b2cd-eeb674b1d094 req-f3610663-e2c0-4402-af50-49d113f0bf59 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-changed-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-461a39ac-1f8a-42c4-b2cd-eeb674b1d094 req-f3610663-e2c0-4402-af50-49d113f0bf59 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Refreshing instance network info cache due to event network-changed-a87f8f30-667e-4321-9d19-04f12f45eb7f. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-461a39ac-1f8a-42c4-b2cd-eeb674b1d094 req-f3610663-e2c0-4402-af50-49d113f0bf59 service nova] Acquiring lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-461a39ac-1f8a-42c4-b2cd-eeb674b1d094 req-f3610663-e2c0-4402-af50-49d113f0bf59 service nova] Acquired lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:18:47 user nova-compute[72426]: DEBUG nova.network.neutron [req-461a39ac-1f8a-42c4-b2cd-eeb674b1d094 req-f3610663-e2c0-4402-af50-49d113f0bf59 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Refreshing network info cache for port a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:18:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updating instance_info_cache with network_info: [{"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Releasing lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:18:48 user nova-compute[72426]: DEBUG nova.network.neutron [req-461a39ac-1f8a-42c4-b2cd-eeb674b1d094 req-f3610663-e2c0-4402-af50-49d113f0bf59 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updated VIF entry in instance network info cache for port a87f8f30-667e-4321-9d19-04f12f45eb7f. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:18:48 user nova-compute[72426]: DEBUG nova.network.neutron [req-461a39ac-1f8a-42c4-b2cd-eeb674b1d094 req-f3610663-e2c0-4402-af50-49d113f0bf59 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updating instance_info_cache with network_info: [{"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-461a39ac-1f8a-42c4-b2cd-eeb674b1d094 req-f3610663-e2c0-4402-af50-49d113f0bf59 service nova] Releasing lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-5f63889a-4244-4f3d-88cf-ad6a2dff5b21 req-4ace1918-bcd4-441e-9ff6-a5ea4d8de25f service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5f63889a-4244-4f3d-88cf-ad6a2dff5b21 req-4ace1918-bcd4-441e-9ff6-a5ea4d8de25f service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5f63889a-4244-4f3d-88cf-ad6a2dff5b21 req-4ace1918-bcd4-441e-9ff6-a5ea4d8de25f service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5f63889a-4244-4f3d-88cf-ad6a2dff5b21 req-4ace1918-bcd4-441e-9ff6-a5ea4d8de25f service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-5f63889a-4244-4f3d-88cf-ad6a2dff5b21 req-4ace1918-bcd4-441e-9ff6-a5ea4d8de25f service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:49 user nova-compute[72426]: WARNING nova.compute.manager [req-5f63889a-4244-4f3d-88cf-ad6a2dff5b21 req-4ace1918-bcd4-441e-9ff6-a5ea4d8de25f service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state building and task_state spawning.
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Instance destroyed successfully.
Aug 01 08:18:49 user nova-compute[72426]: DEBUG nova.objects.instance [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'resources' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-120743636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-120743636',id=23,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmbPf8dfpbOw3AdFtYviiNgMHzZe3NiBwdcr4xPSbxyQfYaP4IAPXsp+HNXQ2y8gncIZv7OS8P7105AkmU3pmjBBpBNxkZJUuHPFEmhtLWG2TELfES9J3p65QCfv2L7SQ==',key_name='tempest-keypair-1007772321',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-kmty00m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member',shelved_at='2023-08-01T08:18:47.722872',shelved_host='user',shelved_image_id='ad84213f-4809-4776-8ba7-74f122f16830'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=a5e525d1-9cbd-4e92-8eea-f256b6edd86e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG os_vif [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32122388-a2, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:18:49 user nova-compute[72426]: INFO os_vif [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2')
Aug 01 08:18:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Deleting instance files /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e_del
Aug 01 08:18:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Deletion of /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e_del complete
Aug 01 08:18:50 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Deleted allocations for instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e
Aug 01 08:18:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-changed-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Refreshing instance network info cache due to event network-changed-32122388-a2bc-410d-91f7-594b4702c6a0. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] Acquiring lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] Acquired lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Refreshing network info cache for port 32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG nova.objects.instance [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'numa_topology' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updated VIF entry in instance network info cache for port 32122388-a2bc-410d-91f7-594b4702c6a0. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updating instance_info_cache with network_info: [{"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap32122388-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] Releasing lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] No waiting events found dispatching network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:50 user nova-compute[72426]: WARNING nova.compute.manager [req-16a91457-a1f0-448f-b7dd-bf908ece841a req-56f391b1-56da-43e2-a5f4-c9285ea89a7a service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received unexpected event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 for instance with vm_state building and task_state spawning.
Aug 01 08:18:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-963d04c0-e571-4ef7-b02e-2e3b858df689 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.334s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-01d320f2-a6b7-49ad-8fc0-83aabff61c7e req-1f7b7a61-c0be-480b-853b-616ac73a59fb service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-01d320f2-a6b7-49ad-8fc0-83aabff61c7e req-1f7b7a61-c0be-480b-853b-616ac73a59fb service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-01d320f2-a6b7-49ad-8fc0-83aabff61c7e req-1f7b7a61-c0be-480b-853b-616ac73a59fb service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-01d320f2-a6b7-49ad-8fc0-83aabff61c7e req-1f7b7a61-c0be-480b-853b-616ac73a59fb service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-01d320f2-a6b7-49ad-8fc0-83aabff61c7e req-1f7b7a61-c0be-480b-853b-616ac73a59fb service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:51 user nova-compute[72426]: WARNING nova.compute.manager [req-01d320f2-a6b7-49ad-8fc0-83aabff61c7e req-1f7b7a61-c0be-480b-853b-616ac73a59fb service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state building and task_state spawning.
Aug 01 08:18:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-dd0b37cc-da59-480c-87c8-326ac5e50f09 req-591bf9bd-e116-447e-a4b9-e8b194286c1d service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dd0b37cc-da59-480c-87c8-326ac5e50f09 req-591bf9bd-e116-447e-a4b9-e8b194286c1d service nova] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dd0b37cc-da59-480c-87c8-326ac5e50f09 req-591bf9bd-e116-447e-a4b9-e8b194286c1d service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dd0b37cc-da59-480c-87c8-326ac5e50f09 req-591bf9bd-e116-447e-a4b9-e8b194286c1d service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-dd0b37cc-da59-480c-87c8-326ac5e50f09 req-591bf9bd-e116-447e-a4b9-e8b194286c1d service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] No waiting events found dispatching network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:18:52 user nova-compute[72426]: WARNING nova.compute.manager [req-dd0b37cc-da59-480c-87c8-326ac5e50f09 req-591bf9bd-e116-447e-a4b9-e8b194286c1d service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received unexpected event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 for instance with vm_state building and task_state spawning.
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877932.2699318, 711f36c5-6692-4aec-b4fe-0aac97dfef12 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] VM Resumed (Lifecycle Event)
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Instance spawned successfully.
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Instance spawned successfully.
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877932.2720716, 711f36c5-6692-4aec-b4fe-0aac97dfef12 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] VM Started (Lifecycle Event)
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877932.27558, 05637642-f020-48af-b44a-d48e25a598fa => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] VM Resumed (Lifecycle Event)
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Took 7.92 seconds to spawn the instance on the hypervisor.
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Took 7.72 seconds to spawn the instance on the hypervisor.
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877932.2783043, 05637642-f020-48af-b44a-d48e25a598fa => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] VM Started (Lifecycle Event)
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Took 23.67 seconds to build instance.
Aug 01 08:18:52 user nova-compute[72426]: INFO nova.compute.manager [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Took 9.08 seconds to build instance.
Aug 01 08:18:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2352bf4f-218d-418f-b098-4fac9b1ac848 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.792s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-acba26b0-d101-4862-89f3-425860ae7488 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.206s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:18:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:18:59 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877924.0415804, a5e525d1-9cbd-4e92-8eea-f256b6edd86e => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:18:59 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] VM Stopped (Lifecycle Event)
Aug 01 08:18:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-eb771942-93a7-4262-a5f0-b6ba3ba0d3b6 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:18:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:19:03 user nova-compute[72426]: INFO nova.compute.manager [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] instance snapshotting
Aug 01 08:19:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Beginning live snapshot process
Aug 01 08:19:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json -f qcow2 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json -f qcow2 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpra4cwcg3/d9c2f28811d94e12acdb37e5f399d339.delta 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpra4cwcg3/d9c2f28811d94e12acdb37e5f399d339.delta 1073741824" returned: 0 in 0.049s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:04 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 08:19:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72426) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 08:19:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72426) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 08:19:05 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 08:19:05 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:19:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpra4cwcg3/d9c2f28811d94e12acdb37e5f399d339.delta /opt/stack/data/nova/instances/snapshots/tmpra4cwcg3/d9c2f28811d94e12acdb37e5f399d339 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpra4cwcg3/d9c2f28811d94e12acdb37e5f399d339.delta /opt/stack/data/nova/instances/snapshots/tmpra4cwcg3/d9c2f28811d94e12acdb37e5f399d339" returned: 0 in 0.779s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Snapshot extracted, beginning image upload
Aug 01 08:19:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:08 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Snapshot image upload complete
Aug 01 08:19:08 user nova-compute[72426]: INFO nova.compute.manager [None req-b94e8590-885d-451d-b121-cf80b9368e42 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Took 5.23 seconds to snapshot the instance on the hypervisor.
Aug 01 08:19:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-20df52de-51cb-4e7c-8b4b-f213c9b7e1f9 req-c7ec6e53-7da3-4aeb-b0c5-f88ae0116a84 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-changed-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-20df52de-51cb-4e7c-8b4b-f213c9b7e1f9 req-c7ec6e53-7da3-4aeb-b0c5-f88ae0116a84 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Refreshing instance network info cache due to event network-changed-883a5e52-3445-4ce9-aebd-8a5c59e18e63. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:19:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-20df52de-51cb-4e7c-8b4b-f213c9b7e1f9 req-c7ec6e53-7da3-4aeb-b0c5-f88ae0116a84 service nova] Acquiring lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:19:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-20df52de-51cb-4e7c-8b4b-f213c9b7e1f9 req-c7ec6e53-7da3-4aeb-b0c5-f88ae0116a84 service nova] Acquired lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:19:20 user nova-compute[72426]: DEBUG nova.network.neutron [req-20df52de-51cb-4e7c-8b4b-f213c9b7e1f9 req-c7ec6e53-7da3-4aeb-b0c5-f88ae0116a84 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Refreshing network info cache for port 883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:19:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-20df52de-51cb-4e7c-8b4b-f213c9b7e1f9 req-c7ec6e53-7da3-4aeb-b0c5-f88ae0116a84 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updated VIF entry in instance network info cache for port 883a5e52-3445-4ce9-aebd-8a5c59e18e63. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:19:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-20df52de-51cb-4e7c-8b4b-f213c9b7e1f9 req-c7ec6e53-7da3-4aeb-b0c5-f88ae0116a84 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updating instance_info_cache with network_info: [{"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:19:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-20df52de-51cb-4e7c-8b4b-f213c9b7e1f9 req-c7ec6e53-7da3-4aeb-b0c5-f88ae0116a84 service nova] Releasing lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Stashing vm_state: active {{(pid=72426) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'pci_requests' on Instance uuid 2572e472-73fe-4e5a-b486-e38274a978d7 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:19:22 user nova-compute[72426]: INFO nova.compute.claims [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Claim successful on node user
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'resources' on Instance uuid 2572e472-73fe-4e5a-b486-e38274a978d7 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'pci_devices' on Instance uuid 2572e472-73fe-4e5a-b486-e38274a978d7 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:19:22 user nova-compute[72426]: INFO nova.compute.resource_tracker [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating resource usage from migration cfdcf0f0-2e1d-4ef4-94b9-7e75c2b4b466
Aug 01 08:19:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-9efb6a12-76b3-4eb3-b635-88c2a568f203 req-a87aa571-77cf-4099-ac3b-442905a6cdd6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-changed-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-9efb6a12-76b3-4eb3-b635-88c2a568f203 req-a87aa571-77cf-4099-ac3b-442905a6cdd6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Refreshing instance network info cache due to event network-changed-4f7d2fe1-5bf7-4270-a15a-11c145726e16. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9efb6a12-76b3-4eb3-b635-88c2a568f203 req-a87aa571-77cf-4099-ac3b-442905a6cdd6 service nova] Acquiring lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9efb6a12-76b3-4eb3-b635-88c2a568f203 req-a87aa571-77cf-4099-ac3b-442905a6cdd6 service nova] Acquired lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.network.neutron [req-9efb6a12-76b3-4eb3-b635-88c2a568f203 req-a87aa571-77cf-4099-ac3b-442905a6cdd6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Refreshing network info cache for port 4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:19:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.624s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:22 user nova-compute[72426]: INFO nova.compute.manager [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Migrating
Aug 01 08:19:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.194s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:19:23 user nova-compute[72426]: INFO nova.compute.claims [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Claim successful on node user
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.network.neutron [req-9efb6a12-76b3-4eb3-b635-88c2a568f203 req-a87aa571-77cf-4099-ac3b-442905a6cdd6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updated VIF entry in instance network info cache for port 4f7d2fe1-5bf7-4270-a15a-11c145726e16. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.network.neutron [req-9efb6a12-76b3-4eb3-b635-88c2a568f203 req-a87aa571-77cf-4099-ac3b-442905a6cdd6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating instance_info_cache with network_info: [{"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9efb6a12-76b3-4eb3-b635-88c2a568f203 req-a87aa571-77cf-4099-ac3b-442905a6cdd6 service nova] Releasing lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquired lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.network.neutron [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:19:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.compute.manager [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:19:23 user nova-compute[72426]: INFO nova.virt.block_device [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Booting with volume 28656c75-f762-4c35-b55a-7f9878b6d83b at /dev/vda
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating instance_info_cache with network_info: [{"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.policy [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49f9ffcf2a8a435a968fd41590d90607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f71856fa7cb47b998a77b3f4ba436d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Releasing lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG os_brick.utils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1d880c-96de-4590-b2d0-ee76f8ea0201]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[652f259d-07a3-44e2-97ec-dee9304d28ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3768f90-09c8-4084-99c1-2832ae689c2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[de410af7-f12b-410a-a02b-f29435169b39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:19:23 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:19:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[282d9d8c-1596-47d9-9328-8bcb5f67c61d]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG os_brick.utils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Updating existing volume attachment record: b5af7a70-83e9-4e02-b4e9-36fdf8ec0fca {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:19:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Starting migrate_disk_and_power_off {{(pid=72426) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-1d1cbcfc-a190-460a-993d-996d7ab51506 req-7b39a257-6f9f-43de-8ce2-3db31993b6d6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-vif-unplugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1d1cbcfc-a190-460a-993d-996d7ab51506 req-7b39a257-6f9f-43de-8ce2-3db31993b6d6 service nova] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1d1cbcfc-a190-460a-993d-996d7ab51506 req-7b39a257-6f9f-43de-8ce2-3db31993b6d6 service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1d1cbcfc-a190-460a-993d-996d7ab51506 req-7b39a257-6f9f-43de-8ce2-3db31993b6d6 service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-1d1cbcfc-a190-460a-993d-996d7ab51506 req-7b39a257-6f9f-43de-8ce2-3db31993b6d6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] No waiting events found dispatching network-vif-unplugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:19:24 user nova-compute[72426]: WARNING nova.compute.manager [req-1d1cbcfc-a190-460a-993d-996d7ab51506 req-7b39a257-6f9f-43de-8ce2-3db31993b6d6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received unexpected event network-vif-unplugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 for instance with vm_state active and task_state resize_migrating.
Aug 01 08:19:24 user nova-compute[72426]: DEBUG nova.network.neutron [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Successfully created port: e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:19:24 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Instance destroyed successfully.
Aug 01 08:19:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2008460603',display_name='tempest-ServerActionsTestOtherA-server-2008460603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2008460603',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-fivwx9jg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=2572e472-73fe-4e5a-b486-e38274a978d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1798029701-network", "vif_mac": "fa:16:3e:00:51:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1798029701-network", "vif_mac": "fa:16:3e:00:51:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_vif [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f7d2fe1-5b, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:19:24 user nova-compute[72426]: INFO os_vif [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b')
Aug 01 08:19:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUPEtQHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:19:24 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbb278e-0973-4f72-88a0-52487a25831c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32f3b14-c7ab-415a-9aa4-cab47d8fa52f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:24 user nova-compute[72426]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:24 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:24 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:24 user nova-compute[72426]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:24 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:24 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38c35f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7489b14-1727-4cac-8b44-e23a6b6305fe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[316df132-5693-45d6-91d7-56fe7dca58a4]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fc4816-9f15-4f0a-a740-879fca46433b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95b57be-cc62-4bdd-9a38-dbef25b0ba29]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bc8e35f4', '/dev/disk/by-id/scsi-23236313764633730', '/dev/disk/by-id/scsi-1SCST_BIObc8e35f4-2617dc707f57601c') {{(pid=83442) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa5cff7-5105-488a-aa69-cd5c1e2a5b0c]: (4, None) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee151c9-89b3-4600-82a9-bb6c04b79cbb]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[439d1da2-1eb2-4704-8e96-25f99d5cbb87]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260]
Aug 01 08:19:25 user nova-compute[72426]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260] successful.
Aug 01 08:19:25 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a491b4c8-6b99-4ab6-ba8a-7859e111f480]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== disconnect_volume: return (318ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG nova.network.neutron [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Successfully updated port: e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "refresh_cache-6dd67de0-9c20-48ce-a73c-1a0092bca1a3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquired lock "refresh_cache-6dd67de0-9c20-48ce-a73c-1a0092bca1a3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG nova.network.neutron [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a70c248-8370-442b-a3a1-f55b6f906872 req-9fff75e4-2637-46e0-9543-d29f58f81a7f service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received event network-changed-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a70c248-8370-442b-a3a1-f55b6f906872 req-9fff75e4-2637-46e0-9543-d29f58f81a7f service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Refreshing instance network info cache due to event network-changed-e423bc05-c489-41d1-bbc6-2554c36b6abe. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a70c248-8370-442b-a3a1-f55b6f906872 req-9fff75e4-2637-46e0-9543-d29f58f81a7f service nova] Acquiring lock "refresh_cache-6dd67de0-9c20-48ce-a73c-1a0092bca1a3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:19:25 user nova-compute[72426]: DEBUG nova.network.neutron [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG nova.network.neutron [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Updating instance_info_cache with network_info: [{"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Releasing lock "refresh_cache-6dd67de0-9c20-48ce-a73c-1a0092bca1a3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Instance network_info: |[{"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a70c248-8370-442b-a3a1-f55b6f906872 req-9fff75e4-2637-46e0-9543-d29f58f81a7f service nova] Acquired lock "refresh_cache-6dd67de0-9c20-48ce-a73c-1a0092bca1a3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG nova.network.neutron [req-6a70c248-8370-442b-a3a1-f55b6f906872 req-9fff75e4-2637-46e0-9543-d29f58f81a7f service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Refreshing network info cache for port e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Port 4f7d2fe1-5bf7-4270-a15a-11c145726e16 binding to destination host user is already ACTIVE {{(pid=72426) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquired lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-22222ee3-27a6-4e6f-b431-af1c93c01e35 req-a95d6717-9e84-4031-86af-51faf0f1801c service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-22222ee3-27a6-4e6f-b431-af1c93c01e35 req-a95d6717-9e84-4031-86af-51faf0f1801c service nova] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-22222ee3-27a6-4e6f-b431-af1c93c01e35 req-a95d6717-9e84-4031-86af-51faf0f1801c service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-22222ee3-27a6-4e6f-b431-af1c93c01e35 req-a95d6717-9e84-4031-86af-51faf0f1801c service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-22222ee3-27a6-4e6f-b431-af1c93c01e35 req-a95d6717-9e84-4031-86af-51faf0f1801c service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] No waiting events found dispatching network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:19:26 user nova-compute[72426]: WARNING nova.compute.manager [req-22222ee3-27a6-4e6f-b431-af1c93c01e35 req-a95d6717-9e84-4031-86af-51faf0f1801c service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received unexpected event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 for instance with vm_state active and task_state resize_migrated.
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG nova.network.neutron [req-6a70c248-8370-442b-a3a1-f55b6f906872 req-9fff75e4-2637-46e0-9543-d29f58f81a7f service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Updated VIF entry in instance network info cache for port e423bc05-c489-41d1-bbc6-2554c36b6abe. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG nova.network.neutron [req-6a70c248-8370-442b-a3a1-f55b6f906872 req-9fff75e4-2637-46e0-9543-d29f58f81a7f service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Updating instance_info_cache with network_info: [{"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a70c248-8370-442b-a3a1-f55b6f906872 req-9fff75e4-2637-46e0-9543-d29f58f81a7f service nova] Releasing lock "refresh_cache-6dd67de0-9c20-48ce-a73c-1a0092bca1a3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating instance_info_cache with network_info: [{"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Releasing lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG os_brick.utils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c707515-934c-4c4d-9608-2ceaecc68348]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a061378-2b69-4806-b5cc-47baa9780bb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[891a113d-fd50-414a-aa95-3cd2253a3925]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c3cf4a-152e-49a5-9bc7-e9d64cf48653]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:19:27 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b815e04b-9806-4bad-beae-3bc46753171b]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG os_brick.utils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:19:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:19:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:19:30 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:19:30 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:19:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7102MB free_disk=25.38519287109375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:19:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Applying migration context for instance 2572e472-73fe-4e5a-b486-e38274a978d7 as it has an incoming, in-progress migration cfdcf0f0-2e1d-4ef4-94b9-7e75c2b4b466. Migration status is post-migrating {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 08:19:30 user nova-compute[72426]: INFO nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating resource usage from migration cfdcf0f0-2e1d-4ef4-94b9-7e75c2b4b466
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 73fb06b8-0824-42fc-bbfd-6914bdb78824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance adcf2dea-a758-4e13-9091-fffa6339f670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance e1119088-18c7-483d-a89d-3b5d19054e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 711f36c5-6692-4aec-b4fe-0aac97dfef12 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 05637642-f020-48af-b44a-d48e25a598fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Migration cfdcf0f0-2e1d-4ef4-94b9-7e75c2b4b466 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2572e472-73fe-4e5a-b486-e38274a978d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 6dd67de0-9c20-48ce-a73c-1a0092bca1a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.objects.instance [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'flavor' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:31 user nova-compute[72426]: INFO nova.compute.manager [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Attaching volume 37b8e7f7-9793-43d3-8930-7618be0208fc to /dev/vdb
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.808s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] There are 0 instances to clean {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72426) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG os_brick.utils [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba361c6-ed29-4fff-94f9-7eac8152c0f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d16c6-cb61-41c1-9a75-1e73cf99c88a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3941f8b8-0e6f-4600-80dd-a0f86e9f29b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7a2404-4c75-4edd-899c-b20dd22a0631]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:19:31 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:19:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[954ba29c-4b0b-4c2c-bd86-d328b2af599e]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG os_brick.utils [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:19:31 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updating existing volume attachment record: 46a2f0f3-c2a6-4702-9f22-5a880765958d {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:19:32 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Creating image(s)
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Ensure instance console log exists: /opt/stack/data/nova/instances/6dd67de0-9c20-48ce-a73c-1a0092bca1a3/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Start _get_guest_xml network_info=[{"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGCRnFkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6dd67de0-9c20-48ce-a73c-1a0092bca1a3', 'attached_at': '', 'detached_at': '', 'volume_id': '28656c75-f762-4c35-b55a-7f9878b6d83b', 'serial': '28656c75-f762-4c35-b55a-7f9878b6d83b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'b5af7a70-83e9-4e02-b4e9-36fdf8ec0fca', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:19:32 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:19:32 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGCRnFkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:19:32 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:19:32 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:19:32 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7079f67-4caf-4de2-8057-6aab17c980fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:19:32 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37aafeb-a632-4934-9844-84625433c562]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b] added
Aug 01 08:19:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd81c49e-5738-4259-ae4c-c5c2634f66e9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d93a932-5e4f-4879-9c03-3b3f445d8506]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jGCRnFkb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jGCRnFkb" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75b26b8-fa4a-48e7-8c70-e50ed1b07c47]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jGCRnFkb'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[df172819-c7c4-49c4-8bd3-c87b561805df]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dc3627-c853-40c3-a0fe-fa53f14846e8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:32 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:32 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb110bcf-2edf-4263-ad5e-22e9322ca93f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b, portal: 172.16.0.220,3260]
Aug 01 08:19:32 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b, portal: 172.16.0.220,3260] successful.
Aug 01 08:19:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2878c27-7ff4-4c9d-9ae8-a266ae08bd97]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[040d43f0-a5d9-450b-97ce-8ecf38368b43]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:32 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:32 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:32 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:32 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a957b-d63a-490a-86be-b73ea7032b33]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:19:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGCRnFkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23765663966633834', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765663966633834', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1696646090',display_name='tempest-TestVolumeBootPattern-server-1696646090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1696646090',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwAhreXMhTB8T7LTS3WDX6kRgXb9BnVYEZYQPoF5FGH3bUHuQnuMUueZ+xzRUaxNgyiXc9pf2QAsQhWnhK9+E2tjM6RN1qVUihVAZ+qSqWDvdICQ1ao5vxLw9JyWyV35g==',key_name='tempest-TestVolumeBootPattern-315952015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-qqltch17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:19:24Z,user_data=None,user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=6dd67de0-9c20-48ce-a73c-1a0092bca1a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=e423bc05-c489-41d1-bbc6-2554c36b6abe,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape423bc05-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dd67de0-9c20-48ce-a73c-1a0092bca1a3 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:19:33 user nova-compute[72426]:   <uuid>6dd67de0-9c20-48ce-a73c-1a0092bca1a3</uuid>
Aug 01 08:19:33 user nova-compute[72426]:   <name>instance-0000001e</name>
Aug 01 08:19:33 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:19:33 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:19:33 user nova-compute[72426]:   <metadata>
Aug 01 08:19:33 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:19:33 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:19:33 user nova-compute[72426]:       <nova:name>tempest-TestVolumeBootPattern-server-1696646090</nova:name>
Aug 01 08:19:33 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:19:32</nova:creationTime>
Aug 01 08:19:33 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:19:33 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:19:33 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:19:33 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:19:33 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:19:33 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:19:33 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:19:33 user nova-compute[72426]:       <nova:owner>
Aug 01 08:19:33 user nova-compute[72426]:         <nova:user uuid="49f9ffcf2a8a435a968fd41590d90607">tempest-TestVolumeBootPattern-942085866-project-member</nova:user>
Aug 01 08:19:33 user nova-compute[72426]:         <nova:project uuid="6f71856fa7cb47b998a77b3f4ba436d7">tempest-TestVolumeBootPattern-942085866</nova:project>
Aug 01 08:19:33 user nova-compute[72426]:       </nova:owner>
Aug 01 08:19:33 user nova-compute[72426]:       <nova:ports>
Aug 01 08:19:33 user nova-compute[72426]:         <nova:port uuid="e423bc05-c489-41d1-bbc6-2554c36b6abe">
Aug 01 08:19:33 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 08:19:33 user nova-compute[72426]:         </nova:port>
Aug 01 08:19:33 user nova-compute[72426]:       </nova:ports>
Aug 01 08:19:33 user nova-compute[72426]:     </nova:instance>
Aug 01 08:19:33 user nova-compute[72426]:   </metadata>
Aug 01 08:19:33 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:19:33 user nova-compute[72426]:     <system>
Aug 01 08:19:33 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:19:33 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:19:33 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:19:33 user nova-compute[72426]:       <entry name="serial">6dd67de0-9c20-48ce-a73c-1a0092bca1a3</entry>
Aug 01 08:19:33 user nova-compute[72426]:       <entry name="uuid">6dd67de0-9c20-48ce-a73c-1a0092bca1a3</entry>
Aug 01 08:19:33 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:19:33 user nova-compute[72426]:     </system>
Aug 01 08:19:33 user nova-compute[72426]:   </sysinfo>
Aug 01 08:19:33 user nova-compute[72426]:   <os>
Aug 01 08:19:33 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:19:33 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:19:33 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:19:33 user nova-compute[72426]:   </os>
Aug 01 08:19:33 user nova-compute[72426]:   <features>
Aug 01 08:19:33 user nova-compute[72426]:     <acpi/>
Aug 01 08:19:33 user nova-compute[72426]:     <apic/>
Aug 01 08:19:33 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:19:33 user nova-compute[72426]:   </features>
Aug 01 08:19:33 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:19:33 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:19:33 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:19:33 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:19:33 user nova-compute[72426]:   </clock>
Aug 01 08:19:33 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:19:33 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:19:33 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:19:33 user nova-compute[72426]:   </cpu>
Aug 01 08:19:33 user nova-compute[72426]:   <devices>
Aug 01 08:19:33 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:19:33 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:19:33 user nova-compute[72426]:       <source dev="/dev/sdc"/>
Aug 01 08:19:33 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:19:33 user nova-compute[72426]:       <serial>28656c75-f762-4c35-b55a-7f9878b6d83b</serial>
Aug 01 08:19:33 user nova-compute[72426]:     </disk>
Aug 01 08:19:33 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:19:33 user nova-compute[72426]:       <mac address="fa:16:3e:0e:18:e8"/>
Aug 01 08:19:33 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:19:33 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:19:33 user nova-compute[72426]:       <target dev="tape423bc05-c4"/>
Aug 01 08:19:33 user nova-compute[72426]:     </interface>
Aug 01 08:19:33 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:19:33 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/6dd67de0-9c20-48ce-a73c-1a0092bca1a3/console.log" append="off"/>
Aug 01 08:19:33 user nova-compute[72426]:     </serial>
Aug 01 08:19:33 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:19:33 user nova-compute[72426]:     <video>
Aug 01 08:19:33 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:19:33 user nova-compute[72426]:     </video>
Aug 01 08:19:33 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:19:33 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:19:33 user nova-compute[72426]:     </rng>
Aug 01 08:19:33 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:19:33 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:19:33 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:19:33 user nova-compute[72426]:     </memballoon>
Aug 01 08:19:33 user nova-compute[72426]:   </devices>
Aug 01 08:19:33 user nova-compute[72426]: </domain>
Aug 01 08:19:33 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1696646090',display_name='tempest-TestVolumeBootPattern-server-1696646090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1696646090',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwAhreXMhTB8T7LTS3WDX6kRgXb9BnVYEZYQPoF5FGH3bUHuQnuMUueZ+xzRUaxNgyiXc9pf2QAsQhWnhK9+E2tjM6RN1qVUihVAZ+qSqWDvdICQ1ao5vxLw9JyWyV35g==',key_name='tempest-TestVolumeBootPattern-315952015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-qqltch17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:19:24Z,user_data=None,user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=6dd67de0-9c20-48ce-a73c-1a0092bca1a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=e423bc05-c489-41d1-bbc6-2554c36b6abe,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape423bc05-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG os_vif [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=e423bc05-c489-41d1-bbc6-2554c36b6abe,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape423bc05-c4') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape423bc05-c4, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape423bc05-c4, col_values=(('external_ids', {'iface-id': 'e423bc05-c489-41d1-bbc6-2554c36b6abe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:18:e8', 'vm-uuid': '6dd67de0-9c20-48ce-a73c-1a0092bca1a3'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:33 user nova-compute[72426]: INFO os_vif [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=e423bc05-c489-41d1-bbc6-2554c36b6abe,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape423bc05-c4')
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:19:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] No VIF found with MAC fa:16:3e:0e:18:e8, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:19:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:19:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:19:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:19:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:19:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-270e77f7-179c-450d-83a6-b2a3f1394100 req-dee78332-4b70-4c39-aad4-2850a9123650 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-changed-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-270e77f7-179c-450d-83a6-b2a3f1394100 req-dee78332-4b70-4c39-aad4-2850a9123650 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Refreshing instance network info cache due to event network-changed-9f0b410f-c412-4817-9db3-b9ec5ffe8c09. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:19:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-270e77f7-179c-450d-83a6-b2a3f1394100 req-dee78332-4b70-4c39-aad4-2850a9123650 service nova] Acquiring lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:19:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-270e77f7-179c-450d-83a6-b2a3f1394100 req-dee78332-4b70-4c39-aad4-2850a9123650 service nova] Acquired lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:19:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-270e77f7-179c-450d-83a6-b2a3f1394100 req-dee78332-4b70-4c39-aad4-2850a9123650 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Refreshing network info cache for port 9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Starting finish_migration {{(pid=72426) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Instance directory exists: not creating {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 08:19:35 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Creating image(s)
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Ensure instance console log exists: /opt/stack/data/nova/instances/2572e472-73fe-4e5a-b486-e38274a978d7/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Start _get_guest_xml network_info=[{"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1798029701-network", "vif_mac": "fa:16:3e:00:51:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUPEtQHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2572e472-73fe-4e5a-b486-e38274a978d7', 'attached_at': '2023-08-01T08:19:35.000000', 'detached_at': '', 'volume_id': '1ba8f463-9a40-4627-bb28-92ef381bde3a', 'serial': '1ba8f463-9a40-4627-bb28-92ef381bde3a'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '177a888c-f598-4622-8803-8db3f5e6a995', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:19:35 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:19:35 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:37Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2572e472-73fe-4e5a-b486-e38274a978d7 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUPEtQHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:19:35 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:19:35 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:19:35 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updating instance_info_cache with network_info: [{"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc6e64d-cd81-4b3c-8765-8bf21051db7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:19:35 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c17c81-98fe-4d1a-901d-4f458854f35c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a] added
Aug 01 08:19:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51ad2a6-0baf-4ca1-a1c9-7e7b56b70a7b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d154a2-ed6f-4448-8268-d0d22977d1e1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUPEtQHh {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUPEtQHh" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[527d1a0a-d606-42de-b3a3-2f25b0391071]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eUPEtQHh'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f8d398-044b-4395-8089-6b8bb7e49787]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7659f401-e0a9-40fe-bb2a-c2ae4d95829a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:35 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:35 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:35 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:35 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[edebd28d-7e62-4ae0-84cb-00e6a20500e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260]
Aug 01 08:19:35 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260] successful.
Aug 01 08:19:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cedc35-154c-4a00-bf2e-8df2a8fc3f16]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad5a4df-84de-4b31-8382-1d00c8e6f06e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:35 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:35 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:35 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:35 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:35 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:35 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-270e77f7-179c-450d-83a6-b2a3f1394100 req-dee78332-4b70-4c39-aad4-2850a9123650 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Updated VIF entry in instance network info cache for port 9f0b410f-c412-4817-9db3-b9ec5ffe8c09. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-270e77f7-179c-450d-83a6-b2a3f1394100 req-dee78332-4b70-4c39-aad4-2850a9123650 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Updating instance_info_cache with network_info: [{"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e22f4f4-3ec9-4527-9cb8-ba08a5c3400b]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:35 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-270e77f7-179c-450d-83a6-b2a3f1394100 req-dee78332-4b70-4c39-aad4-2850a9123650 service nova] Releasing lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received event network-vif-plugged-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] Acquiring lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] No waiting events found dispatching network-vif-plugged-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:19:36 user nova-compute[72426]: WARNING nova.compute.manager [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received unexpected event network-vif-plugged-e423bc05-c489-41d1-bbc6-2554c36b6abe for instance with vm_state building and task_state spawning.
Aug 01 08:19:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received event network-vif-plugged-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] Acquiring lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] No waiting events found dispatching network-vif-plugged-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:19:36 user nova-compute[72426]: WARNING nova.compute.manager [req-099ab840-989d-4006-8b0c-cc72430d9b68 req-b3de2027-87d4-4441-aca2-c96d600637e1 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received unexpected event network-vif-plugged-e423bc05-c489-41d1-bbc6-2554c36b6abe for instance with vm_state building and task_state spawning.
Aug 01 08:19:36 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUPEtQHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23236313764633730', 'path': '/dev/sde'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:19:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236313764633730', 'path': '/dev/sde'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2008460603',display_name='tempest-ServerActionsTestOtherA-server-2008460603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2008460603',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-fivwx9jg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=2572e472-73fe-4e5a-b486-e38274a978d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1798029701-network", "vif_mac": "fa:16:3e:00:51:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1798029701-network", "vif_mac": "fa:16:3e:00:51:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:19:37 user nova-compute[72426]:   <uuid>2572e472-73fe-4e5a-b486-e38274a978d7</uuid>
Aug 01 08:19:37 user nova-compute[72426]:   <name>instance-00000019</name>
Aug 01 08:19:37 user nova-compute[72426]:   <memory>2097152</memory>
Aug 01 08:19:37 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:19:37 user nova-compute[72426]:   <metadata>
Aug 01 08:19:37 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:19:37 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:19:37 user nova-compute[72426]:       <nova:name>tempest-ServerActionsTestOtherA-server-2008460603</nova:name>
Aug 01 08:19:37 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:19:35</nova:creationTime>
Aug 01 08:19:37 user nova-compute[72426]:       <nova:flavor name="m1.small">
Aug 01 08:19:37 user nova-compute[72426]:         <nova:memory>2048</nova:memory>
Aug 01 08:19:37 user nova-compute[72426]:         <nova:disk>20</nova:disk>
Aug 01 08:19:37 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:19:37 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:19:37 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:19:37 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:19:37 user nova-compute[72426]:       <nova:owner>
Aug 01 08:19:37 user nova-compute[72426]:         <nova:user uuid="63a663fe54d7469a97f5642e0847a2d4">tempest-ServerActionsTestOtherA-355781192-project-member</nova:user>
Aug 01 08:19:37 user nova-compute[72426]:         <nova:project uuid="77facd98c6ac4726939b5599e6c72a9b">tempest-ServerActionsTestOtherA-355781192</nova:project>
Aug 01 08:19:37 user nova-compute[72426]:       </nova:owner>
Aug 01 08:19:37 user nova-compute[72426]:       <nova:ports>
Aug 01 08:19:37 user nova-compute[72426]:         <nova:port uuid="4f7d2fe1-5bf7-4270-a15a-11c145726e16">
Aug 01 08:19:37 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 08:19:37 user nova-compute[72426]:         </nova:port>
Aug 01 08:19:37 user nova-compute[72426]:       </nova:ports>
Aug 01 08:19:37 user nova-compute[72426]:     </nova:instance>
Aug 01 08:19:37 user nova-compute[72426]:   </metadata>
Aug 01 08:19:37 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:19:37 user nova-compute[72426]:     <system>
Aug 01 08:19:37 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:19:37 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:19:37 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:19:37 user nova-compute[72426]:       <entry name="serial">2572e472-73fe-4e5a-b486-e38274a978d7</entry>
Aug 01 08:19:37 user nova-compute[72426]:       <entry name="uuid">2572e472-73fe-4e5a-b486-e38274a978d7</entry>
Aug 01 08:19:37 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:19:37 user nova-compute[72426]:     </system>
Aug 01 08:19:37 user nova-compute[72426]:   </sysinfo>
Aug 01 08:19:37 user nova-compute[72426]:   <os>
Aug 01 08:19:37 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:19:37 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:19:37 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:19:37 user nova-compute[72426]:   </os>
Aug 01 08:19:37 user nova-compute[72426]:   <features>
Aug 01 08:19:37 user nova-compute[72426]:     <acpi/>
Aug 01 08:19:37 user nova-compute[72426]:     <apic/>
Aug 01 08:19:37 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:19:37 user nova-compute[72426]:   </features>
Aug 01 08:19:37 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:19:37 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:19:37 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:19:37 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:19:37 user nova-compute[72426]:   </clock>
Aug 01 08:19:37 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:19:37 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:19:37 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:19:37 user nova-compute[72426]:   </cpu>
Aug 01 08:19:37 user nova-compute[72426]:   <devices>
Aug 01 08:19:37 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:19:37 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:19:37 user nova-compute[72426]:       <source dev="/dev/sde"/>
Aug 01 08:19:37 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:19:37 user nova-compute[72426]:       <serial>1ba8f463-9a40-4627-bb28-92ef381bde3a</serial>
Aug 01 08:19:37 user nova-compute[72426]:     </disk>
Aug 01 08:19:37 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:19:37 user nova-compute[72426]:       <mac address="fa:16:3e:00:51:b6"/>
Aug 01 08:19:37 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:19:37 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:19:37 user nova-compute[72426]:       <target dev="tap4f7d2fe1-5b"/>
Aug 01 08:19:37 user nova-compute[72426]:     </interface>
Aug 01 08:19:37 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:19:37 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/2572e472-73fe-4e5a-b486-e38274a978d7/console.log" append="off"/>
Aug 01 08:19:37 user nova-compute[72426]:     </serial>
Aug 01 08:19:37 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:19:37 user nova-compute[72426]:     <video>
Aug 01 08:19:37 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:19:37 user nova-compute[72426]:     </video>
Aug 01 08:19:37 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:19:37 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:19:37 user nova-compute[72426]:     </rng>
Aug 01 08:19:37 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:19:37 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:19:37 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:19:37 user nova-compute[72426]:     </memballoon>
Aug 01 08:19:37 user nova-compute[72426]:   </devices>
Aug 01 08:19:37 user nova-compute[72426]: </domain>
Aug 01 08:19:37 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2008460603',display_name='tempest-ServerActionsTestOtherA-server-2008460603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2008460603',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-fivwx9jg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=2572e472-73fe-4e5a-b486-e38274a978d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1798029701-network", "vif_mac": "fa:16:3e:00:51:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1798029701-network", "vif_mac": "fa:16:3e:00:51:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG os_vif [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f7d2fe1-5b, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f7d2fe1-5b, col_values=(('external_ids', {'iface-id': '4f7d2fe1-5bf7-4270-a15a-11c145726e16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:51:b6', 'vm-uuid': '2572e472-73fe-4e5a-b486-e38274a978d7'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:37 user nova-compute[72426]: INFO os_vif [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b')
Aug 01 08:19:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] No VIF found with MAC fa:16:3e:00:51:b6, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877977.6158924, 6dd67de0-9c20-48ce-a73c-1a0092bca1a3 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:19:37 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] VM Resumed (Lifecycle Event)
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:19:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Instance spawned successfully.
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:19:37 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877977.6180882, 6dd67de0-9c20-48ce-a73c-1a0092bca1a3 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:19:37 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] VM Started (Lifecycle Event)
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:19:37 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:19:37 user nova-compute[72426]: INFO nova.compute.manager [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 01 08:19:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:19:37 user nova-compute[72426]: INFO nova.compute.manager [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Took 15.06 seconds to build instance.
Aug 01 08:19:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-391c135f-5c5e-40d9-8917-640ddbf09cae tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.188s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-6270f711-8030-4612-9684-7ca12ebbfb30 req-2abaf44e-6af5-4761-92ca-6972f3f4696a service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6270f711-8030-4612-9684-7ca12ebbfb30 req-2abaf44e-6af5-4761-92ca-6972f3f4696a service nova] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6270f711-8030-4612-9684-7ca12ebbfb30 req-2abaf44e-6af5-4761-92ca-6972f3f4696a service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6270f711-8030-4612-9684-7ca12ebbfb30 req-2abaf44e-6af5-4761-92ca-6972f3f4696a service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-6270f711-8030-4612-9684-7ca12ebbfb30 req-2abaf44e-6af5-4761-92ca-6972f3f4696a service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] No waiting events found dispatching network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:19:38 user nova-compute[72426]: WARNING nova.compute.manager [req-6270f711-8030-4612-9684-7ca12ebbfb30 req-2abaf44e-6af5-4761-92ca-6972f3f4696a service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received unexpected event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 for instance with vm_state active and task_state resize_finish.
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:39 user nova-compute[72426]: INFO nova.compute.manager [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Attaching volume de3d896b-64bc-473a-a1d3-090164bd228e to /dev/vdb
Aug 01 08:19:39 user nova-compute[72426]: DEBUG os_brick.utils [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[219424fe-6312-47cc-9db6-e82fb8059388]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fec7e3-55c2-433b-878e-5b41dd78d1fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8de897-7bf1-49a6-8f31-dddaa9de0aec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[66616170-849e-4982-935b-b48836b7766c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:19:39 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:19:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5861bf51-b016-447d-95d1-5bd34bfb25aa]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG os_brick.utils [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Updating existing volume attachment record: 8889d195-adae-4d36-a66e-0dc2894fae61 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:19:39 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877964.7726612, 2572e472-73fe-4e5a-b486-e38274a978d7 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:19:39 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] VM Stopped (Lifecycle Event)
Aug 01 08:19:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-1d8cd7c0-796c-47b4-9672-944b9a5066ee None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfoGIwAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:19:40 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:19:40 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:19:40 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcf1191-cece-4b8b-9ace-2aea4316de74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:19:40 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd05c84a-93a2-446b-9580-1a538c3b5c7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc] added
Aug 01 08:19:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9907c36b-7103-400d-be49-3c01fc9a9240]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8287c8c1-6980-41b4-8693-d5a70f7b27d5]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tfoGIwAq {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tfoGIwAq" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d4fe47-971b-4407-b184-c64d14898bb2]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tfoGIwAq'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a145c7c-30ae-4abf-8b43-525c39514cc6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc7344e-54e4-4b61-b66e-f124ddb9e018]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdfbd2f-9b37-4a07-af06-ecfa89e344a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260]
Aug 01 08:19:40 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260] successful.
Aug 01 08:19:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d75f4e-281f-42b0-b955-80933e7a017c]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa263e1-e7a5-458e-b5b6-24c891c12122]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:19:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:40 user nova-compute[72426]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:19:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e0bd6f-d8e0-4402-926a-7c7477d71bde]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-a7ff1121-8603-4383-a5e1-4ef91d29a334 req-0abf966f-599f-415c-ac03-c62b8cd0c566 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a7ff1121-8603-4383-a5e1-4ef91d29a334 req-0abf966f-599f-415c-ac03-c62b8cd0c566 service nova] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a7ff1121-8603-4383-a5e1-4ef91d29a334 req-0abf966f-599f-415c-ac03-c62b8cd0c566 service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a7ff1121-8603-4383-a5e1-4ef91d29a334 req-0abf966f-599f-415c-ac03-c62b8cd0c566 service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-a7ff1121-8603-4383-a5e1-4ef91d29a334 req-0abf966f-599f-415c-ac03-c62b8cd0c566 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] No waiting events found dispatching network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:19:40 user nova-compute[72426]: WARNING nova.compute.manager [req-a7ff1121-8603-4383-a5e1-4ef91d29a334 req-0abf966f-599f-415c-ac03-c62b8cd0c566 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received unexpected event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 for instance with vm_state active and task_state resize_finish.
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877981.358512, 2572e472-73fe-4e5a-b486-e38274a978d7 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:19:41 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] VM Resumed (Lifecycle Event)
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:19:41 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Instance running successfully.
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Failed to set time: agent not configured {{(pid=72426) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff98fa87-b8c5-47f0-a6b7-b48ac093bf81 tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] finish_migration finished successfully. {{(pid=72426) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:19:41 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690877981.358978, 2572e472-73fe-4e5a-b486-e38274a978d7 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:19:41 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] VM Started (Lifecycle Event)
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:19:41 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 08:19:41 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:19:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfoGIwAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:19:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:19:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23865656636313533', 'path': '/dev/sdf'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865656636313533', 'path': '/dev/sdf'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.objects.instance [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'flavor' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:19:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:19:41 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:19:41 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:19:41 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:19:41 user nova-compute[72426]:   <serial>37b8e7f7-9793-43d3-8930-7618be0208fc</serial>
Aug 01 08:19:41 user nova-compute[72426]: </disk>
Aug 01 08:19:41 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:19:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:19:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:19:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] No VIF found with MAC fa:16:3e:48:94:bf, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:19:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-98a68450-dfaf-4f21-bdef-43427de28cfe tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.610s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtroyQLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:19:48 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:19:48 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:19:48 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bc056a-7039-491a-8fce-0bc3b177e6fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:19:48 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fb7a4c-a824-481c-a52e-00a55eb5f091]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e] added
Aug 01 08:19:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6defbf-da2f-4750-92de-a07822a75dcf]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d47960-c915-431a-a9ac-efaacda80910]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtroyQLi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtroyQLi" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c45fb48-cd5a-4a8e-ae68-7edfd3ab83a0]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtroyQLi'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4fea63-c813-4bfb-9dcb-22536b8ccdc1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d9569b-f33a-4151-ad53-1a8fa79d40cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:19:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:19:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88748a7-3e13-464b-af57-6731f672f605]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260]
Aug 01 08:19:48 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260] successful.
Aug 01 08:19:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd955e-820c-451c-855d-27f07a9f9ee9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[81174f14-e6ae-498a-bcbf-65e3b0245b0b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:19:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:19:48 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:19:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a993b813-2458-402a-967b-46d2baa1b448]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:19:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtroyQLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:19:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:19:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23761663837336465', 'path': '/dev/sdg'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:19:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761663837336465', 'path': '/dev/sdg'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:19:49 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:19:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:19:49 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:19:49 user nova-compute[72426]:   <source dev="/dev/sdg"/>
Aug 01 08:19:49 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:19:49 user nova-compute[72426]:   <serial>de3d896b-64bc-473a-a1d3-090164bd228e</serial>
Aug 01 08:19:49 user nova-compute[72426]: </disk>
Aug 01 08:19:49 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:19:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:19:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:19:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No VIF found with MAC fa:16:3e:d4:cf:4b, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:19:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2bfdbf26-8984-4ebf-b52f-ccd571af3fdf tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.820s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c48d6193-dd1e-4cec-a52d-e205a992e3ee tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c48d6193-dd1e-4cec-a52d-e205a992e3ee tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:51 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c48d6193-dd1e-4cec-a52d-e205a992e3ee tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:19:51 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c48d6193-dd1e-4cec-a52d-e205a992e3ee tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72426) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 08:19:51 user nova-compute[72426]: DEBUG nova.objects.instance [None req-c48d6193-dd1e-4cec-a52d-e205a992e3ee tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:19:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-f95fb8b5-1a4e-4702-8b9d-8b3ae97028cb req-ead3a818-9deb-44f9-9838-0a8d8a0d9071 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f95fb8b5-1a4e-4702-8b9d-8b3ae97028cb req-ead3a818-9deb-44f9-9838-0a8d8a0d9071 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f95fb8b5-1a4e-4702-8b9d-8b3ae97028cb req-ead3a818-9deb-44f9-9838-0a8d8a0d9071 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f95fb8b5-1a4e-4702-8b9d-8b3ae97028cb req-ead3a818-9deb-44f9-9838-0a8d8a0d9071 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-f95fb8b5-1a4e-4702-8b9d-8b3ae97028cb req-ead3a818-9deb-44f9-9838-0a8d8a0d9071 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:19:52 user nova-compute[72426]: WARNING nova.compute.manager [req-f95fb8b5-1a4e-4702-8b9d-8b3ae97028cb req-ead3a818-9deb-44f9-9838-0a8d8a0d9071 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state active and task_state powering-off.
Aug 01 08:19:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:52 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance destroyed successfully.
Aug 01 08:19:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c48d6193-dd1e-4cec-a52d-e205a992e3ee tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:19:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c48d6193-dd1e-4cec-a52d-e205a992e3ee tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.934s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-b5bc80b5-0496-43f3-ad1b-f645671cdec8 req-9446aebe-6917-4896-83fb-7b42710daece service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b5bc80b5-0496-43f3-ad1b-f645671cdec8 req-9446aebe-6917-4896-83fb-7b42710daece service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:19:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b5bc80b5-0496-43f3-ad1b-f645671cdec8 req-9446aebe-6917-4896-83fb-7b42710daece service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:19:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b5bc80b5-0496-43f3-ad1b-f645671cdec8 req-9446aebe-6917-4896-83fb-7b42710daece service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:19:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-b5bc80b5-0496-43f3-ad1b-f645671cdec8 req-9446aebe-6917-4896-83fb-7b42710daece service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:19:54 user nova-compute[72426]: WARNING nova.compute.manager [req-b5bc80b5-0496-43f3-ad1b-f645671cdec8 req-9446aebe-6917-4896-83fb-7b42710daece service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state stopped and task_state None.
Aug 01 08:19:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-bb523d15-f7d3-40e6-a361-4c9fba9aa1c2 req-903475e1-d566-4dcb-82b2-15a1642f1e75 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-changed-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-bb523d15-f7d3-40e6-a361-4c9fba9aa1c2 req-903475e1-d566-4dcb-82b2-15a1642f1e75 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Refreshing instance network info cache due to event network-changed-725650f1-c621-47c2-bb87-a85d41c698d3. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:19:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bb523d15-f7d3-40e6-a361-4c9fba9aa1c2 req-903475e1-d566-4dcb-82b2-15a1642f1e75 service nova] Acquiring lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:19:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bb523d15-f7d3-40e6-a361-4c9fba9aa1c2 req-903475e1-d566-4dcb-82b2-15a1642f1e75 service nova] Acquired lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:19:55 user nova-compute[72426]: DEBUG nova.network.neutron [req-bb523d15-f7d3-40e6-a361-4c9fba9aa1c2 req-903475e1-d566-4dcb-82b2-15a1642f1e75 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Refreshing network info cache for port 725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:19:55 user nova-compute[72426]: DEBUG nova.network.neutron [req-bb523d15-f7d3-40e6-a361-4c9fba9aa1c2 req-903475e1-d566-4dcb-82b2-15a1642f1e75 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updated VIF entry in instance network info cache for port 725650f1-c621-47c2-bb87-a85d41c698d3. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:19:55 user nova-compute[72426]: DEBUG nova.network.neutron [req-bb523d15-f7d3-40e6-a361-4c9fba9aa1c2 req-903475e1-d566-4dcb-82b2-15a1642f1e75 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updating instance_info_cache with network_info: [{"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:19:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bb523d15-f7d3-40e6-a361-4c9fba9aa1c2 req-903475e1-d566-4dcb-82b2-15a1642f1e75 service nova] Releasing lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:19:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:19:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-dda29ea3-ecc6-4548-9dca-73895b49090f req-1e5d2f50-6b63-46ec-914b-5e68d51bc04d service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-changed-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:19:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-dda29ea3-ecc6-4548-9dca-73895b49090f req-1e5d2f50-6b63-46ec-914b-5e68d51bc04d service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Refreshing instance network info cache due to event network-changed-725650f1-c621-47c2-bb87-a85d41c698d3. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:19:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dda29ea3-ecc6-4548-9dca-73895b49090f req-1e5d2f50-6b63-46ec-914b-5e68d51bc04d service nova] Acquiring lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:19:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dda29ea3-ecc6-4548-9dca-73895b49090f req-1e5d2f50-6b63-46ec-914b-5e68d51bc04d service nova] Acquired lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:19:57 user nova-compute[72426]: DEBUG nova.network.neutron [req-dda29ea3-ecc6-4548-9dca-73895b49090f req-1e5d2f50-6b63-46ec-914b-5e68d51bc04d service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Refreshing network info cache for port 725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:19:57 user nova-compute[72426]: DEBUG nova.network.neutron [req-dda29ea3-ecc6-4548-9dca-73895b49090f req-1e5d2f50-6b63-46ec-914b-5e68d51bc04d service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updated VIF entry in instance network info cache for port 725650f1-c621-47c2-bb87-a85d41c698d3. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:19:57 user nova-compute[72426]: DEBUG nova.network.neutron [req-dda29ea3-ecc6-4548-9dca-73895b49090f req-1e5d2f50-6b63-46ec-914b-5e68d51bc04d service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updating instance_info_cache with network_info: [{"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:19:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dda29ea3-ecc6-4548-9dca-73895b49090f req-1e5d2f50-6b63-46ec-914b-5e68d51bc04d service nova] Releasing lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:20:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:01 user nova-compute[72426]: INFO nova.compute.manager [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Rebooting instance
Aug 01 08:20:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:20:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquired lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:20:01 user nova-compute[72426]: DEBUG nova.network.neutron [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updating instance_info_cache with network_info: [{"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Releasing lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG nova.compute.manager [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-de561ace-f304-463a-a0a0-957227c62c0d req-77b4dcb1-9ac3-4ffc-b9e6-b95a7ce6b22d service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-vif-unplugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-de561ace-f304-463a-a0a0-957227c62c0d req-77b4dcb1-9ac3-4ffc-b9e6-b95a7ce6b22d service nova] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-de561ace-f304-463a-a0a0-957227c62c0d req-77b4dcb1-9ac3-4ffc-b9e6-b95a7ce6b22d service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-de561ace-f304-463a-a0a0-957227c62c0d req-77b4dcb1-9ac3-4ffc-b9e6-b95a7ce6b22d service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-de561ace-f304-463a-a0a0-957227c62c0d req-77b4dcb1-9ac3-4ffc-b9e6-b95a7ce6b22d service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] No waiting events found dispatching network-vif-unplugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:02 user nova-compute[72426]: WARNING nova.compute.manager [req-de561ace-f304-463a-a0a0-957227c62c0d req-77b4dcb1-9ac3-4ffc-b9e6-b95a7ce6b22d service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received unexpected event network-vif-unplugged-725650f1-c621-47c2-bb87-a85d41c698d3 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 08:20:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Instance destroyed successfully.
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.objects.instance [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'resources' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1203897786',display_name='tempest-TestMinimumBasicScenario-server-1203897786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1203897786',id=26,image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaUW+O2gXcs5Qlc9T+gdA+5NS0imiYGw6BG+/0Lan/Dk2AXl3sI2AxVbrhv3fSt5K7N28XqNEPLWtlUEs1dy0X6Wd/7PlKxrwd7J5dxnOgWb2xNIOi/3d+UGC37t1MUHQ==',key_name='tempest-TestMinimumBasicScenario-680132469',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85beb29b81c84c9bb0b49c8bdb107d50',ramdisk_id='',reservation_id='r-k2ymo0md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-307605778',owner_user_name='tempest-TestMinimumBasicScenario-307605778-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:20:02Z,user_data=None,user_id='46cce858652440719bed7e5473ffb18d',uuid=adcf2dea-a758-4e13-9091-fffa6339f670,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converting VIF {"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_vif [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap725650f1-c6, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:03 user nova-compute[72426]: INFO os_vif [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6')
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfoGIwAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:20:03 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62226ce-db4a-47e4-ba8a-3b608f0d78be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8943e02d-7b41-47f1-86d9-b5b7b1c35bea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38c4f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc'): ({'sdf'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Removing single pathed devices sdf {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1552ecc8-1012-4d9a-99f2-e8b90a29821c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a9ff14-cc93-45fc-afeb-d20d134aa348]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Flushing IO for device /dev/sdf {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ee730-7f85-44bc-8d3e-59f6c23b4aaf]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e386faaf-9f61-462e-8b45-fa652f9d8d5c]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f45e3a-44ba-4d9f-b607-cd7870da0802]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[db507629-fb15-4f4e-a792-cf4e835658bb]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260]
Aug 01 08:20:03 user nova-compute[72426]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260] successful.
Aug 01 08:20:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74d774b-a6a5-42b4-bbe3-ca745a12b036]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] <== disconnect_volume: return (334ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Start _get_guest_xml network_info=[{"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6080de30-d80c-4ca7-890f-c3b91f52f7df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '6080de30-d80c-4ca7-890f-c3b91f52f7df'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfoGIwAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'adcf2dea-a758-4e13-9091-fffa6339f670', 'attached_at': '', 'detached_at': '', 'volume_id': '37b8e7f7-9793-43d3-8930-7618be0208fc', 'serial': '37b8e7f7-9793-43d3-8930-7618be0208fc'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '46a2f0f3-c2a6-4702-9f22-5a880765958d', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:20:03 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:20:03 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6080de30-d80c-4ca7-890f-c3b91f52f7df,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.objects.instance [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'vcpu_model' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfoGIwAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:20:03 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:03 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:03 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf401712-fd27-4530-a0d7-31c488c7dcea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:20:03 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfbff33-c966-4de2-83d1-7d6ff13679c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc] added
Aug 01 08:20:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4e26ca-4e29-457e-9b9d-d5e09711a328]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d01a0e2-952b-444a-9604-1ba4f766853d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tfoGIwAq {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tfoGIwAq" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a747d7c-7509-4e00-a932-7bd0e21b0d11]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tfoGIwAq'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd82ba8c-b7ee-427e-b13a-c2fbfc603f88]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[141473cc-ea5a-490f-b9de-84cb08d76b88]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[630058f4-38ba-4f3b-9506-e48d1aac05d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260]
Aug 01 08:20:03 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260] successful.
Aug 01 08:20:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ada286-a3bc-4889-894e-ec3de2db55b1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc8a803-3c03-44d1-803b-62367d429610]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:03 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bda6e9f-982b-4e14-80e8-fbbac259250e]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:20:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfoGIwAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-3b735911-a2fc-467d-b319-bb5b2e26f7c8 req-6010ea62-7b39-48ad-926c-8249fc1da6c1 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3b735911-a2fc-467d-b319-bb5b2e26f7c8 req-6010ea62-7b39-48ad-926c-8249fc1da6c1 service nova] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3b735911-a2fc-467d-b319-bb5b2e26f7c8 req-6010ea62-7b39-48ad-926c-8249fc1da6c1 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3b735911-a2fc-467d-b319-bb5b2e26f7c8 req-6010ea62-7b39-48ad-926c-8249fc1da6c1 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-3b735911-a2fc-467d-b319-bb5b2e26f7c8 req-6010ea62-7b39-48ad-926c-8249fc1da6c1 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] No waiting events found dispatching network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:04 user nova-compute[72426]: WARNING nova.compute.manager [req-3b735911-a2fc-467d-b319-bb5b2e26f7c8 req-6010ea62-7b39-48ad-926c-8249fc1da6c1 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received unexpected event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 08:20:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23865656636313533', 'path': '/dev/sdf'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865656636313533', 'path': '/dev/sdf'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1203897786',display_name='tempest-TestMinimumBasicScenario-server-1203897786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1203897786',id=26,image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaUW+O2gXcs5Qlc9T+gdA+5NS0imiYGw6BG+/0Lan/Dk2AXl3sI2AxVbrhv3fSt5K7N28XqNEPLWtlUEs1dy0X6Wd/7PlKxrwd7J5dxnOgWb2xNIOi/3d+UGC37t1MUHQ==',key_name='tempest-TestMinimumBasicScenario-680132469',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85beb29b81c84c9bb0b49c8bdb107d50',ramdisk_id='',reservation_id='r-k2ymo0md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-307605778',owner_user_name='tempest-TestMinimumBasicScenario-307605778-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:20:02Z,user_data=None,user_id='46cce858652440719bed7e5473ffb18d',uuid=adcf2dea-a758-4e13-9091-fffa6339f670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converting VIF {"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG nova.objects.instance [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'pci_devices' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:20:04 user nova-compute[72426]:   <uuid>adcf2dea-a758-4e13-9091-fffa6339f670</uuid>
Aug 01 08:20:04 user nova-compute[72426]:   <name>instance-0000001a</name>
Aug 01 08:20:04 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:20:04 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:20:04 user nova-compute[72426]:   <metadata>
Aug 01 08:20:04 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:20:04 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:20:04 user nova-compute[72426]:       <nova:name>tempest-TestMinimumBasicScenario-server-1203897786</nova:name>
Aug 01 08:20:04 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:20:03</nova:creationTime>
Aug 01 08:20:04 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:20:04 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:20:04 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:20:04 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:20:04 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:20:04 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:20:04 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:20:04 user nova-compute[72426]:       <nova:owner>
Aug 01 08:20:04 user nova-compute[72426]:         <nova:user uuid="46cce858652440719bed7e5473ffb18d">tempest-TestMinimumBasicScenario-307605778-project-member</nova:user>
Aug 01 08:20:04 user nova-compute[72426]:         <nova:project uuid="85beb29b81c84c9bb0b49c8bdb107d50">tempest-TestMinimumBasicScenario-307605778</nova:project>
Aug 01 08:20:04 user nova-compute[72426]:       </nova:owner>
Aug 01 08:20:04 user nova-compute[72426]:       <nova:root type="image" uuid="6080de30-d80c-4ca7-890f-c3b91f52f7df"/>
Aug 01 08:20:04 user nova-compute[72426]:       <nova:ports>
Aug 01 08:20:04 user nova-compute[72426]:         <nova:port uuid="725650f1-c621-47c2-bb87-a85d41c698d3">
Aug 01 08:20:04 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 08:20:04 user nova-compute[72426]:         </nova:port>
Aug 01 08:20:04 user nova-compute[72426]:       </nova:ports>
Aug 01 08:20:04 user nova-compute[72426]:     </nova:instance>
Aug 01 08:20:04 user nova-compute[72426]:   </metadata>
Aug 01 08:20:04 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:20:04 user nova-compute[72426]:     <system>
Aug 01 08:20:04 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:20:04 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:20:04 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:20:04 user nova-compute[72426]:       <entry name="serial">adcf2dea-a758-4e13-9091-fffa6339f670</entry>
Aug 01 08:20:04 user nova-compute[72426]:       <entry name="uuid">adcf2dea-a758-4e13-9091-fffa6339f670</entry>
Aug 01 08:20:04 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:20:04 user nova-compute[72426]:     </system>
Aug 01 08:20:04 user nova-compute[72426]:   </sysinfo>
Aug 01 08:20:04 user nova-compute[72426]:   <os>
Aug 01 08:20:04 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:20:04 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:20:04 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:20:04 user nova-compute[72426]:   </os>
Aug 01 08:20:04 user nova-compute[72426]:   <features>
Aug 01 08:20:04 user nova-compute[72426]:     <acpi/>
Aug 01 08:20:04 user nova-compute[72426]:     <apic/>
Aug 01 08:20:04 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:20:04 user nova-compute[72426]:   </features>
Aug 01 08:20:04 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:20:04 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:20:04 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:20:04 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:20:04 user nova-compute[72426]:   </clock>
Aug 01 08:20:04 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:20:04 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:20:04 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:20:04 user nova-compute[72426]:   </cpu>
Aug 01 08:20:04 user nova-compute[72426]:   <devices>
Aug 01 08:20:04 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:20:04 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:20:04 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk"/>
Aug 01 08:20:04 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:20:04 user nova-compute[72426]:     </disk>
Aug 01 08:20:04 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:20:04 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:20:04 user nova-compute[72426]:       <source dev="/dev/sdf"/>
Aug 01 08:20:04 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:20:04 user nova-compute[72426]:       <serial>37b8e7f7-9793-43d3-8930-7618be0208fc</serial>
Aug 01 08:20:04 user nova-compute[72426]:     </disk>
Aug 01 08:20:04 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:20:04 user nova-compute[72426]:       <mac address="fa:16:3e:48:94:bf"/>
Aug 01 08:20:04 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:20:04 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:20:04 user nova-compute[72426]:       <target dev="tap725650f1-c6"/>
Aug 01 08:20:04 user nova-compute[72426]:     </interface>
Aug 01 08:20:04 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:20:04 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/console.log" append="off"/>
Aug 01 08:20:04 user nova-compute[72426]:     </serial>
Aug 01 08:20:04 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:20:04 user nova-compute[72426]:     <video>
Aug 01 08:20:04 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:20:04 user nova-compute[72426]:     </video>
Aug 01 08:20:04 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:20:04 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:20:04 user nova-compute[72426]:     </rng>
Aug 01 08:20:04 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:20:04 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:20:04 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:20:04 user nova-compute[72426]:     </memballoon>
Aug 01 08:20:04 user nova-compute[72426]:   </devices>
Aug 01 08:20:04 user nova-compute[72426]: </domain>
Aug 01 08:20:04 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'trusted_certs' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e3abd2642be3e6e6d736461414db66b2e7ffbd0 --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Cannot resize image /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'migration_context' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1203897786',display_name='tempest-TestMinimumBasicScenario-server-1203897786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1203897786',id=26,image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaUW+O2gXcs5Qlc9T+gdA+5NS0imiYGw6BG+/0Lan/Dk2AXl3sI2AxVbrhv3fSt5K7N28XqNEPLWtlUEs1dy0X6Wd/7PlKxrwd7J5dxnOgWb2xNIOi/3d+UGC37t1MUHQ==',key_name='tempest-TestMinimumBasicScenario-680132469',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='85beb29b81c84c9bb0b49c8bdb107d50',ramdisk_id='',reservation_id='r-k2ymo0md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-307605778',owner_user_name='tempest-TestMinimumBasicScenario-307605778-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:20:02Z,user_data=None,user_id='46cce858652440719bed7e5473ffb18d',uuid=adcf2dea-a758-4e13-9091-fffa6339f670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converting VIF {"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG os_vif [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap725650f1-c6, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap725650f1-c6, col_values=(('external_ids', {'iface-id': '725650f1-c621-47c2-bb87-a85d41c698d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:94:bf', 'vm-uuid': 'adcf2dea-a758-4e13-9091-fffa6339f670'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:20:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:05 user nova-compute[72426]: INFO os_vif [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6')
Aug 01 08:20:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-863eb1f0-0595-4501-9318-5ba52eb633fe req-d337c030-c505-4dda-9b69-26f4bc0bd569 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-863eb1f0-0595-4501-9318-5ba52eb633fe req-d337c030-c505-4dda-9b69-26f4bc0bd569 service nova] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-863eb1f0-0595-4501-9318-5ba52eb633fe req-d337c030-c505-4dda-9b69-26f4bc0bd569 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-863eb1f0-0595-4501-9318-5ba52eb633fe req-d337c030-c505-4dda-9b69-26f4bc0bd569 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-863eb1f0-0595-4501-9318-5ba52eb633fe req-d337c030-c505-4dda-9b69-26f4bc0bd569 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] No waiting events found dispatching network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:07 user nova-compute[72426]: WARNING nova.compute.manager [req-863eb1f0-0595-4501-9318-5ba52eb633fe req-d337c030-c505-4dda-9b69-26f4bc0bd569 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received unexpected event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 08:20:07 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690877992.4142003, e1119088-18c7-483d-a89d-3b5d19054e52 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:20:07 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] VM Stopped (Lifecycle Event)
Aug 01 08:20:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8369b0e6-33db-4fc3-a144-5ddd50cb8917 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8369b0e6-33db-4fc3-a144-5ddd50cb8917 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for adcf2dea-a758-4e13-9091-fffa6339f670 due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878009.4191225, adcf2dea-a758-4e13-9091-fffa6339f670 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:20:09 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] VM Resumed (Lifecycle Event)
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:20:09 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Instance rebooted successfully.
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-96bc518e-16f5-4c91-a4a8-8437955724ea req-17997711-81ff-4d61-9279-04125f282f05 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-96bc518e-16f5-4c91-a4a8-8437955724ea req-17997711-81ff-4d61-9279-04125f282f05 service nova] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-96bc518e-16f5-4c91-a4a8-8437955724ea req-17997711-81ff-4d61-9279-04125f282f05 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-96bc518e-16f5-4c91-a4a8-8437955724ea req-17997711-81ff-4d61-9279-04125f282f05 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-96bc518e-16f5-4c91-a4a8-8437955724ea req-17997711-81ff-4d61-9279-04125f282f05 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] No waiting events found dispatching network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:09 user nova-compute[72426]: WARNING nova.compute.manager [req-96bc518e-16f5-4c91-a4a8-8437955724ea req-17997711-81ff-4d61-9279-04125f282f05 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received unexpected event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:20:09 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878009.4239914, adcf2dea-a758-4e13-9091-fffa6339f670 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:20:09 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] VM Started (Lifecycle Event)
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-536adad7-9c7a-4f15-a9ca-bf7f44ed58c8 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.939s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:20:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "b4d8cd69-296b-4253-badc-75e771af39b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:11 user nova-compute[72426]: DEBUG nova.compute.manager [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:20:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:11 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:20:11 user nova-compute[72426]: INFO nova.compute.claims [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Claim successful on node user
Aug 01 08:20:11 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Refreshing inventories for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 08:20:11 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Updating ProviderTree inventory for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 08:20:11 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Updating inventory in ProviderTree for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 08:20:11 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Refreshing aggregate associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, aggregates: None {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 08:20:11 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Refreshing trait associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, traits: COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 08:20:12 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:20:12 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:20:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:20:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:20:12 user nova-compute[72426]: DEBUG nova.network.neutron [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:20:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:12 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:20:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:20:12 user nova-compute[72426]: INFO nova.virt.block_device [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Booting with volume-backed-image d15c2a71-abe5-4334-bf77-67be8f572ede at /dev/vda
Aug 01 08:20:12 user nova-compute[72426]: DEBUG nova.policy [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '184d71425948492e835ea8f0dd857d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0b6971ed0a343468f071e1e25c27d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:20:13 user nova-compute[72426]: DEBUG nova.network.neutron [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Successfully created port: f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:20:13 user nova-compute[72426]: DEBUG nova.network.neutron [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Successfully updated port: f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:20:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:20:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquired lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:20:13 user nova-compute[72426]: DEBUG nova.network.neutron [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:20:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-10d76d93-2580-4e96-91ae-c05c832a136c req-fb82329a-0701-450a-82f7-8d568d22afb4 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-changed-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-10d76d93-2580-4e96-91ae-c05c832a136c req-fb82329a-0701-450a-82f7-8d568d22afb4 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Refreshing instance network info cache due to event network-changed-f57a2eab-0805-47c8-a545-d2e08590b2d1. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:20:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-10d76d93-2580-4e96-91ae-c05c832a136c req-fb82329a-0701-450a-82f7-8d568d22afb4 service nova] Acquiring lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:20:13 user nova-compute[72426]: DEBUG nova.network.neutron [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:20:14 user nova-compute[72426]: DEBUG nova.network.neutron [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Updating instance_info_cache with network_info: [{"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:20:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Releasing lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:20:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Instance network_info: |[{"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:20:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-10d76d93-2580-4e96-91ae-c05c832a136c req-fb82329a-0701-450a-82f7-8d568d22afb4 service nova] Acquired lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:20:14 user nova-compute[72426]: DEBUG nova.network.neutron [req-10d76d93-2580-4e96-91ae-c05c832a136c req-fb82329a-0701-450a-82f7-8d568d22afb4 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Refreshing network info cache for port f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:20:14 user nova-compute[72426]: DEBUG nova.network.neutron [req-10d76d93-2580-4e96-91ae-c05c832a136c req-fb82329a-0701-450a-82f7-8d568d22afb4 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Updated VIF entry in instance network info cache for port f57a2eab-0805-47c8-a545-d2e08590b2d1. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:20:14 user nova-compute[72426]: DEBUG nova.network.neutron [req-10d76d93-2580-4e96-91ae-c05c832a136c req-fb82329a-0701-450a-82f7-8d568d22afb4 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Updating instance_info_cache with network_info: [{"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:20:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-10d76d93-2580-4e96-91ae-c05c832a136c req-fb82329a-0701-450a-82f7-8d568d22afb4 service nova] Releasing lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:20:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-a206ca51-5c82-416b-a8c5-67e59c33f8b6 req-77b964f6-6d37-4776-a7af-b0e62aff127e service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-changed-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-a206ca51-5c82-416b-a8c5-67e59c33f8b6 req-77b964f6-6d37-4776-a7af-b0e62aff127e service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Refreshing instance network info cache due to event network-changed-e77776de-abb0-4125-bb7d-69f76d60d9f6. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:20:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a206ca51-5c82-416b-a8c5-67e59c33f8b6 req-77b964f6-6d37-4776-a7af-b0e62aff127e service nova] Acquiring lock "refresh_cache-711f36c5-6692-4aec-b4fe-0aac97dfef12" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:20:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a206ca51-5c82-416b-a8c5-67e59c33f8b6 req-77b964f6-6d37-4776-a7af-b0e62aff127e service nova] Acquired lock "refresh_cache-711f36c5-6692-4aec-b4fe-0aac97dfef12" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:20:20 user nova-compute[72426]: DEBUG nova.network.neutron [req-a206ca51-5c82-416b-a8c5-67e59c33f8b6 req-77b964f6-6d37-4776-a7af-b0e62aff127e service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Refreshing network info cache for port e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:20:21 user nova-compute[72426]: INFO nova.compute.manager [None req-770ebce0-1d8b-404c-83db-fedcd2cb4c8b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Unrescuing
Aug 01 08:20:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-770ebce0-1d8b-404c-83db-fedcd2cb4c8b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:20:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-770ebce0-1d8b-404c-83db-fedcd2cb4c8b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquired lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:20:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-770ebce0-1d8b-404c-83db-fedcd2cb4c8b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:20:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-a206ca51-5c82-416b-a8c5-67e59c33f8b6 req-77b964f6-6d37-4776-a7af-b0e62aff127e service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Updated VIF entry in instance network info cache for port e77776de-abb0-4125-bb7d-69f76d60d9f6. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:20:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-a206ca51-5c82-416b-a8c5-67e59c33f8b6 req-77b964f6-6d37-4776-a7af-b0e62aff127e service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Updating instance_info_cache with network_info: [{"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:20:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a206ca51-5c82-416b-a8c5-67e59c33f8b6 req-77b964f6-6d37-4776-a7af-b0e62aff127e service nova] Releasing lock "refresh_cache-711f36c5-6692-4aec-b4fe-0aac97dfef12" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:20:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-770ebce0-1d8b-404c-83db-fedcd2cb4c8b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updating instance_info_cache with network_info: [{"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:20:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-770ebce0-1d8b-404c-83db-fedcd2cb4c8b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Releasing lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:20:21 user nova-compute[72426]: DEBUG nova.objects.instance [None req-770ebce0-1d8b-404c-83db-fedcd2cb4c8b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'flavor' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-a34eeeec-c56b-4155-b565-70ef0ae97345 req-479f525e-30eb-4a43-bf2f-02caaa19cc1f service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a34eeeec-c56b-4155-b565-70ef0ae97345 req-479f525e-30eb-4a43-bf2f-02caaa19cc1f service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a34eeeec-c56b-4155-b565-70ef0ae97345 req-479f525e-30eb-4a43-bf2f-02caaa19cc1f service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a34eeeec-c56b-4155-b565-70ef0ae97345 req-479f525e-30eb-4a43-bf2f-02caaa19cc1f service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-a34eeeec-c56b-4155-b565-70ef0ae97345 req-479f525e-30eb-4a43-bf2f-02caaa19cc1f service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:22 user nova-compute[72426]: WARNING nova.compute.manager [req-a34eeeec-c56b-4155-b565-70ef0ae97345 req-479f525e-30eb-4a43-bf2f-02caaa19cc1f service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:20:22 user nova-compute[72426]: INFO nova.compute.manager [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Rebuilding instance
Aug 01 08:20:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'trusted_certs' on Instance uuid 711f36c5-6692-4aec-b4fe-0aac97dfef12 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'pci_requests' on Instance uuid 711f36c5-6692-4aec-b4fe-0aac97dfef12 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'pci_devices' on Instance uuid 711f36c5-6692-4aec-b4fe-0aac97dfef12 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'resources' on Instance uuid 711f36c5-6692-4aec-b4fe-0aac97dfef12 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'migration_context' on Instance uuid 711f36c5-6692-4aec-b4fe-0aac97dfef12 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72426) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:22 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Instance destroyed successfully.
Aug 01 08:20:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-f81561ee-e50c-4ab1-bd79-1c3d6105871b req-a1a7f3a8-487c-42c3-9d3f-fa07bc011780 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-vif-unplugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f81561ee-e50c-4ab1-bd79-1c3d6105871b req-a1a7f3a8-487c-42c3-9d3f-fa07bc011780 service nova] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f81561ee-e50c-4ab1-bd79-1c3d6105871b req-a1a7f3a8-487c-42c3-9d3f-fa07bc011780 service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f81561ee-e50c-4ab1-bd79-1c3d6105871b req-a1a7f3a8-487c-42c3-9d3f-fa07bc011780 service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-f81561ee-e50c-4ab1-bd79-1c3d6105871b req-a1a7f3a8-487c-42c3-9d3f-fa07bc011780 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] No waiting events found dispatching network-vif-unplugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:22 user nova-compute[72426]: WARNING nova.compute.manager [req-f81561ee-e50c-4ab1-bd79-1c3d6105871b req-a1a7f3a8-487c-42c3-9d3f-fa07bc011780 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received unexpected event network-vif-unplugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 for instance with vm_state active and task_state rebuilding.
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.utils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd12ff3-b93d-4901-8a92-8b72c7ad2bce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d518c97-368d-4ec6-98dd-7dfe8ca4d8e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc3142-4b34-421c-9af5-dc5d9178018d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[65610dbe-cca5-4c5a-98b3-2114cd1252fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:20:23 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f584c-4e98-4beb-b3b9-6550665f0789]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.utils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Updating existing volume attachment record: 828a5553-88f9-47ea-ae93-f5bc12c77826 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:20:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Instance destroyed successfully.
Aug 01 08:20:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Instance destroyed successfully.
Aug 01 08:20:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-440152097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-386058360',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUuL6cIXOsVrN6GIqUyK3HSUIpRTiR6zIQsvQNqNDHMMOEkoFYsfvVw69PiuMAGsuyCOnnclpwgQI01DdYX76WXL3mjwTVlxrwB/mCjKb1sBbHecoDrcN2Zz6sELtcULg==',key_name='tempest-keypair-2041214637',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7be045e22d244d6984b171cd0345b6ec',ramdisk_id='',reservation_id='r-y0xq8j4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-328470853',owner_user_name='tempest-ServerActionsV293TestJSON-328470853-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3b164242dc4336889758526ddabd74',uuid=711f36c5-6692-4aec-b4fe-0aac97dfef12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converting VIF {"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_vif [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape77776de-ab, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:23 user nova-compute[72426]: INFO os_vif [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab')
Aug 01 08:20:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjYNpHBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:20:23 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b00fc-ab70-4ed4-a91f-de7b5a0ba4ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c919d044-9624-407e-aaec-b764f045c8fb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:23 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:23 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:23 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:23 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:23 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:23 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:23 user nova-compute[72426]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:23 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:23 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:23 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:23 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:23 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38df75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21'): ({'sdd'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Removing single pathed devices sdd {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7052ea-60f6-407b-a9b1-32f063681528]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f57124d-8b3b-4556-a282-c8a140f6fd8e]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Flushing IO for device /dev/sdd {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fb0e04-20aa-4fb4-a3c7-fa47c773f08a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c9ec5-8d72-4202-b7b6-c1a914cdc80d]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee294f6-bde4-4064-8590-362efb4919a9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cbeccc-75d4-40fc-96f5-693697437440]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260]
Aug 01 08:20:23 user nova-compute[72426]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260] successful.
Aug 01 08:20:23 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dbbbdc-031c-4933-8654-84bac371b497]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] <== disconnect_volume: return (347ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:20:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:20:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Deleting instance files /opt/stack/data/nova/instances/711f36c5-6692-4aec-b4fe-0aac97dfef12_del
Aug 01 08:20:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Deletion of /opt/stack/data/nova/instances/711f36c5-6692-4aec-b4fe-0aac97dfef12_del complete
Aug 01 08:20:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-d374e5aa-361c-4ab6-87cb-7c9787a7e980 req-d8c9dd73-ecce-4113-b49f-77b351126256 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d374e5aa-361c-4ab6-87cb-7c9787a7e980 req-d8c9dd73-ecce-4113-b49f-77b351126256 service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d374e5aa-361c-4ab6-87cb-7c9787a7e980 req-d8c9dd73-ecce-4113-b49f-77b351126256 service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d374e5aa-361c-4ab6-87cb-7c9787a7e980 req-d8c9dd73-ecce-4113-b49f-77b351126256 service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-d374e5aa-361c-4ab6-87cb-7c9787a7e980 req-d8c9dd73-ecce-4113-b49f-77b351126256 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:24 user nova-compute[72426]: WARNING nova.compute.manager [req-d374e5aa-361c-4ab6-87cb-7c9787a7e980 req-d8c9dd73-ecce-4113-b49f-77b351126256 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:20:24 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 711f36c5-6692-4aec-b4fe-0aac97dfef12 could not be found.
Aug 01 08:20:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjYNpHBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:20:24 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 08:20:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afd71a0-e810-4cda-a93b-ea86355baa0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ab4a8e-ad86-4b11-994b-d82cfb68a54e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:24 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:24 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:24 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:24 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:24 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:24 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:24 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:24 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:24 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:24 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38c4f1c0>, {}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Disconnecting from: [] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] <== disconnect_volume: return (81ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-6ceb0321-1a5f-4c9f-827c-520d6fcd1fa2 req-67126ebf-75a1-4597-be14-b917c157e7e4 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6ceb0321-1a5f-4c9f-827c-520d6fcd1fa2 req-67126ebf-75a1-4597-be14-b917c157e7e4 service nova] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6ceb0321-1a5f-4c9f-827c-520d6fcd1fa2 req-67126ebf-75a1-4597-be14-b917c157e7e4 service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6ceb0321-1a5f-4c9f-827c-520d6fcd1fa2 req-67126ebf-75a1-4597-be14-b917c157e7e4 service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:24 user nova-compute[72426]: DEBUG nova.compute.manager [req-6ceb0321-1a5f-4c9f-827c-520d6fcd1fa2 req-67126ebf-75a1-4597-be14-b917c157e7e4 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] No waiting events found dispatching network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:24 user nova-compute[72426]: WARNING nova.compute.manager [req-6ceb0321-1a5f-4c9f-827c-520d6fcd1fa2 req-67126ebf-75a1-4597-be14-b917c157e7e4 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received unexpected event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 for instance with vm_state active and task_state rebuilding.
Aug 01 08:20:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Preparing to wait for external event volume-reimaged-b265c54d-477a-4089-a4e6-78d137658f21 {{(pid=72426) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 01 08:20:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:26 user nova-compute[72426]: WARNING nova.compute.manager [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:26 user nova-compute[72426]: WARNING nova.compute.manager [req-a387f9a6-5e52-44ae-8153-1f4c6b9b7db9 req-0dbabb4f-f541-4101-a9f1-2cc61bf0fb86 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for a48d957c-264f-4d4f-a3b7-54e287f606dd due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878026.4787614, a48d957c-264f-4d4f-a3b7-54e287f606dd => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:20:26 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] VM Resumed (Lifecycle Event)
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-770ebce0-1d8b-404c-83db-fedcd2cb4c8b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:20:26 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878026.4839976, a48d957c-264f-4d4f-a3b7-54e287f606dd => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:20:26 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] VM Started (Lifecycle Event)
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:20:30 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:20:30 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7212MB free_disk=25.370548248291016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Applying migration context for instance 2572e472-73fe-4e5a-b486-e38274a978d7 as it has an incoming, in-progress migration cfdcf0f0-2e1d-4ef4-94b9-7e75c2b4b466. Migration status is finished {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 08:20:30 user nova-compute[72426]: INFO nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating resource usage from migration cfdcf0f0-2e1d-4ef4-94b9-7e75c2b4b466
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 73fb06b8-0824-42fc-bbfd-6914bdb78824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance adcf2dea-a758-4e13-9091-fffa6339f670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance e1119088-18c7-483d-a89d-3b5d19054e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 711f36c5-6692-4aec-b4fe-0aac97dfef12 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 05637642-f020-48af-b44a-d48e25a598fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Migration cfdcf0f0-2e1d-4ef4-94b9-7e75c2b4b466 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2572e472-73fe-4e5a-b486-e38274a978d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 6dd67de0-9c20-48ce-a73c-1a0092bca1a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance b4d8cd69-296b-4253-badc-75e771af39b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:20:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.708s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.compute.manager [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:20:31 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Creating image(s)
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Ensure instance console log exists: /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Start _get_guest_xml network_info=[{"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZfTOxPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b4d8cd69-296b-4253-badc-75e771af39b8', 'attached_at': '', 'detached_at': '', 'volume_id': '04960353-544b-49a8-b57f-567aa153b78a', 'serial': '04960353-544b-49a8-b57f-567aa153b78a'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '828a5553-88f9-47ea-ae93-f5bc12c77826', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:20:31 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:20:31 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZfTOxPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:20:31 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:20:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:31 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:20:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:31 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce1ff34-277d-4aca-a08c-5c1c6abe2a37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:20:31 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a6b086-90e3-409d-85b5-a01d7db8f3a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a] added
Aug 01 08:20:31 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8079a8b6-e8bd-49e9-a558-3ba7ba81cc58]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab23982-2625-41c9-b7fa-72e4b231f551]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZfTOxPc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZfTOxPc" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[36199a34-8319-4888-b800-b905a39be85b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZfTOxPc'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8462a9-0b4b-4bd0-88e1-4c8f6a2ffa10]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[345097f2-84d3-4f08-a393-f986332eeac3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fa31aa-b65c-456a-bc0e-2e147784b6b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a, portal: 172.16.0.220,3260]
Aug 01 08:20:32 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a, portal: 172.16.0.220,3260] successful.
Aug 01 08:20:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb03d68-3a10-421b-85b3-d908a5733bac]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[168b71a8-22af-4a16-b440-581df569e534]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:20:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:32 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:20:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[66df2a76-eb7f-4faf-bb45-d0ada0620b66]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZfTOxPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26435323135613531', 'path': '/dev/sdd'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435323135613531', 'path': '/dev/sdd'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1709557568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1709557568',id=31,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-rgo0dk5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:20:12Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=b4d8cd69-296b-4253-badc-75e771af39b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=f57a2eab-0805-47c8-a545-d2e08590b2d1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57a2eab-08') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'pci_devices' on Instance uuid b4d8cd69-296b-4253-badc-75e771af39b8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:20:33 user nova-compute[72426]:   <uuid>b4d8cd69-296b-4253-badc-75e771af39b8</uuid>
Aug 01 08:20:33 user nova-compute[72426]:   <name>instance-0000001f</name>
Aug 01 08:20:33 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:20:33 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:20:33 user nova-compute[72426]:   <metadata>
Aug 01 08:20:33 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:20:33 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:20:33 user nova-compute[72426]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1709557568</nova:name>
Aug 01 08:20:33 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:20:31</nova:creationTime>
Aug 01 08:20:33 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:20:33 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:20:33 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:20:33 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:20:33 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:20:33 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:20:33 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:20:33 user nova-compute[72426]:       <nova:owner>
Aug 01 08:20:33 user nova-compute[72426]:         <nova:user uuid="184d71425948492e835ea8f0dd857d1f">tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member</nova:user>
Aug 01 08:20:33 user nova-compute[72426]:         <nova:project uuid="d0b6971ed0a343468f071e1e25c27d5b">tempest-ServerBootFromVolumeStableRescueTest-2030640431</nova:project>
Aug 01 08:20:33 user nova-compute[72426]:       </nova:owner>
Aug 01 08:20:33 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:20:33 user nova-compute[72426]:       <nova:ports>
Aug 01 08:20:33 user nova-compute[72426]:         <nova:port uuid="f57a2eab-0805-47c8-a545-d2e08590b2d1">
Aug 01 08:20:33 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 08:20:33 user nova-compute[72426]:         </nova:port>
Aug 01 08:20:33 user nova-compute[72426]:       </nova:ports>
Aug 01 08:20:33 user nova-compute[72426]:     </nova:instance>
Aug 01 08:20:33 user nova-compute[72426]:   </metadata>
Aug 01 08:20:33 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:20:33 user nova-compute[72426]:     <system>
Aug 01 08:20:33 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:20:33 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:20:33 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:20:33 user nova-compute[72426]:       <entry name="serial">b4d8cd69-296b-4253-badc-75e771af39b8</entry>
Aug 01 08:20:33 user nova-compute[72426]:       <entry name="uuid">b4d8cd69-296b-4253-badc-75e771af39b8</entry>
Aug 01 08:20:33 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:20:33 user nova-compute[72426]:     </system>
Aug 01 08:20:33 user nova-compute[72426]:   </sysinfo>
Aug 01 08:20:33 user nova-compute[72426]:   <os>
Aug 01 08:20:33 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:20:33 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:20:33 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:20:33 user nova-compute[72426]:   </os>
Aug 01 08:20:33 user nova-compute[72426]:   <features>
Aug 01 08:20:33 user nova-compute[72426]:     <acpi/>
Aug 01 08:20:33 user nova-compute[72426]:     <apic/>
Aug 01 08:20:33 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:20:33 user nova-compute[72426]:   </features>
Aug 01 08:20:33 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:20:33 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:20:33 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:20:33 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:20:33 user nova-compute[72426]:   </clock>
Aug 01 08:20:33 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:20:33 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:20:33 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:20:33 user nova-compute[72426]:   </cpu>
Aug 01 08:20:33 user nova-compute[72426]:   <devices>
Aug 01 08:20:33 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:20:33 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:20:33 user nova-compute[72426]:       <source dev="/dev/sdd"/>
Aug 01 08:20:33 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:20:33 user nova-compute[72426]:       <serial>04960353-544b-49a8-b57f-567aa153b78a</serial>
Aug 01 08:20:33 user nova-compute[72426]:     </disk>
Aug 01 08:20:33 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:20:33 user nova-compute[72426]:       <mac address="fa:16:3e:0d:ae:14"/>
Aug 01 08:20:33 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:20:33 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:20:33 user nova-compute[72426]:       <target dev="tapf57a2eab-08"/>
Aug 01 08:20:33 user nova-compute[72426]:     </interface>
Aug 01 08:20:33 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:20:33 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/console.log" append="off"/>
Aug 01 08:20:33 user nova-compute[72426]:     </serial>
Aug 01 08:20:33 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:20:33 user nova-compute[72426]:     <video>
Aug 01 08:20:33 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:20:33 user nova-compute[72426]:     </video>
Aug 01 08:20:33 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:20:33 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:20:33 user nova-compute[72426]:     </rng>
Aug 01 08:20:33 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:20:33 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:20:33 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:20:33 user nova-compute[72426]:     </memballoon>
Aug 01 08:20:33 user nova-compute[72426]:   </devices>
Aug 01 08:20:33 user nova-compute[72426]: </domain>
Aug 01 08:20:33 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1709557568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1709557568',id=31,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-rgo0dk5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:20:12Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=b4d8cd69-296b-4253-badc-75e771af39b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=f57a2eab-0805-47c8-a545-d2e08590b2d1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57a2eab-08') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG os_vif [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=f57a2eab-0805-47c8-a545-d2e08590b2d1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57a2eab-08') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf57a2eab-08, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf57a2eab-08, col_values=(('external_ids', {'iface-id': 'f57a2eab-0805-47c8-a545-d2e08590b2d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:ae:14', 'vm-uuid': 'b4d8cd69-296b-4253-badc-75e771af39b8'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:33 user nova-compute[72426]: INFO os_vif [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=f57a2eab-0805-47c8-a545-d2e08590b2d1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57a2eab-08')
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:20:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No VIF found with MAC fa:16:3e:0d:ae:14, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-6592de91-a57d-49b1-90c0-de28a2092d98 req-c3dc45fd-f729-45a6-aeb3-796a6cea7ae5 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-changed-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-6592de91-a57d-49b1-90c0-de28a2092d98 req-c3dc45fd-f729-45a6-aeb3-796a6cea7ae5 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Refreshing instance network info cache due to event network-changed-a87f8f30-667e-4321-9d19-04f12f45eb7f. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6592de91-a57d-49b1-90c0-de28a2092d98 req-c3dc45fd-f729-45a6-aeb3-796a6cea7ae5 service nova] Acquiring lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6592de91-a57d-49b1-90c0-de28a2092d98 req-c3dc45fd-f729-45a6-aeb3-796a6cea7ae5 service nova] Acquired lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-6592de91-a57d-49b1-90c0-de28a2092d98 req-c3dc45fd-f729-45a6-aeb3-796a6cea7ae5 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Refreshing network info cache for port a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-1344f1a5-d0d9-437c-8b4d-07ace2bba411 req-37e4144c-6335-4ad0-bbcf-0c45149e2d3a service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1344f1a5-d0d9-437c-8b4d-07ace2bba411 req-37e4144c-6335-4ad0-bbcf-0c45149e2d3a service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1344f1a5-d0d9-437c-8b4d-07ace2bba411 req-37e4144c-6335-4ad0-bbcf-0c45149e2d3a service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1344f1a5-d0d9-437c-8b4d-07ace2bba411 req-37e4144c-6335-4ad0-bbcf-0c45149e2d3a service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-1344f1a5-d0d9-437c-8b4d-07ace2bba411 req-37e4144c-6335-4ad0-bbcf-0c45149e2d3a service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:35 user nova-compute[72426]: WARNING nova.compute.manager [req-1344f1a5-d0d9-437c-8b4d-07ace2bba411 req-37e4144c-6335-4ad0-bbcf-0c45149e2d3a service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state building and task_state spawning.
Aug 01 08:20:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Updating instance_info_cache with network_info: [{"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-6592de91-a57d-49b1-90c0-de28a2092d98 req-c3dc45fd-f729-45a6-aeb3-796a6cea7ae5 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updated VIF entry in instance network info cache for port a87f8f30-667e-4321-9d19-04f12f45eb7f. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-6592de91-a57d-49b1-90c0-de28a2092d98 req-c3dc45fd-f729-45a6-aeb3-796a6cea7ae5 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updating instance_info_cache with network_info: [{"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6592de91-a57d-49b1-90c0-de28a2092d98 req-c3dc45fd-f729-45a6-aeb3-796a6cea7ae5 service nova] Releasing lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:20:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:35 user nova-compute[72426]: INFO nova.compute.manager [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] instance snapshotting
Aug 01 08:20:35 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Beginning live snapshot process
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json -f qcow2 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json -f qcow2 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp98547e3x/d0ce88ba202549cebe3677142124a2f9.delta 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp98547e3x/d0ce88ba202549cebe3677142124a2f9.delta 1073741824" returned: 0 in 0.229s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:36 user nova-compute[72426]: INFO nova.compute.manager [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Unshelving
Aug 01 08:20:36 user nova-compute[72426]: INFO nova.virt.block_device [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Booting with volume 6dbe7101-ebfb-4dfa-8211-c6af5bf20173 at /dev/vdc
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.compute.manager [req-7aea1d13-892a-4b91-91e9-7748702b7d4b req-51d6e8b1-3a17-4583-9051-57f923d87876 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7aea1d13-892a-4b91-91e9-7748702b7d4b req-51d6e8b1-3a17-4583-9051-57f923d87876 service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7aea1d13-892a-4b91-91e9-7748702b7d4b req-51d6e8b1-3a17-4583-9051-57f923d87876 service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7aea1d13-892a-4b91-91e9-7748702b7d4b req-51d6e8b1-3a17-4583-9051-57f923d87876 service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.compute.manager [req-7aea1d13-892a-4b91-91e9-7748702b7d4b req-51d6e8b1-3a17-4583-9051-57f923d87876 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:37 user nova-compute[72426]: WARNING nova.compute.manager [req-7aea1d13-892a-4b91-91e9-7748702b7d4b req-51d6e8b1-3a17-4583-9051-57f923d87876 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state building and task_state spawning.
Aug 01 08:20:37 user nova-compute[72426]: DEBUG os_brick.utils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1fed92-1f9b-4d7a-a5f8-3d367a4d7e96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a024e7ae-a3bb-4a4f-8a21-fab4520ec0fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e8ecd4-dc2d-4bd6-8c40-a1f1185deaf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e19312-5174-4fb5-8a19-efcb83f42911]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:20:37 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24c5fe2-e570-4cfe-b106-4677ad379878]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG os_brick.utils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updating existing volume attachment record: 3a4daa07-19b9-46c4-80d0-09c259dc9559 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878037.2101922, b4d8cd69-296b-4253-badc-75e771af39b8 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:20:37 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] VM Resumed (Lifecycle Event)
Aug 01 08:20:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Instance spawned successfully.
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:20:37 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878037.2168565, b4d8cd69-296b-4253-badc-75e771af39b8 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:20:37 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] VM Started (Lifecycle Event)
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:20:37 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:20:37 user nova-compute[72426]: INFO nova.compute.manager [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:37 user nova-compute[72426]: INFO nova.compute.manager [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Took 26.06 seconds to build instance.
Aug 01 08:20:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-86e90af1-8552-496e-93fc-16951c5a780b tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "b4d8cd69-296b-4253-badc-75e771af39b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.168s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72426) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 08:20:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] COPY block job progress, current cursor: 22020096 final cursor: 75497472 {{(pid=72426) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 08:20:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:20:38 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878023.4757917, 711f36c5-6692-4aec-b4fe-0aac97dfef12 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:20:38 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] VM Stopped (Lifecycle Event)
Aug 01 08:20:38 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3755925f-4f40-4828-b3f6-47a398f56c00 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72426) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 08:20:38 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 08:20:38 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:20:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp98547e3x/d0ce88ba202549cebe3677142124a2f9.delta /opt/stack/data/nova/instances/snapshots/tmp98547e3x/d0ce88ba202549cebe3677142124a2f9 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp98547e3x/d0ce88ba202549cebe3677142124a2f9.delta /opt/stack/data/nova/instances/snapshots/tmp98547e3x/d0ce88ba202549cebe3677142124a2f9" returned: 0 in 0.674s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:39 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Snapshot extracted, beginning image upload
Aug 01 08:20:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:42 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Snapshot image upload complete
Aug 01 08:20:42 user nova-compute[72426]: INFO nova.compute.manager [None req-b93b4bf6-034f-4445-a962-85057563a7a6 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Took 6.62 seconds to snapshot the instance on the hypervisor.
Aug 01 08:20:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-8d065bd7-76e3-4dd2-b40b-718202bfa987 req-f6e68f01-3b60-454a-bf49-11fff06a75f8 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event volume-reimaged-b265c54d-477a-4089-a4e6-78d137658f21 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8d065bd7-76e3-4dd2-b40b-718202bfa987 req-f6e68f01-3b60-454a-bf49-11fff06a75f8 service nova] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8d065bd7-76e3-4dd2-b40b-718202bfa987 req-f6e68f01-3b60-454a-bf49-11fff06a75f8 service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8d065bd7-76e3-4dd2-b40b-718202bfa987 req-f6e68f01-3b60-454a-bf49-11fff06a75f8 service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-8d065bd7-76e3-4dd2-b40b-718202bfa987 req-f6e68f01-3b60-454a-bf49-11fff06a75f8 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Processing event volume-reimaged-b265c54d-477a-4089-a4e6-78d137658f21 {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 01 08:20:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:20:43 user nova-compute[72426]: INFO nova.virt.block_device [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Booting with volume b265c54d-477a-4089-a4e6-78d137658f21 at /dev/vda
Aug 01 08:20:44 user nova-compute[72426]: DEBUG os_brick.utils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e83816f-e827-49cd-9f93-f8cacbc9cbad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[80be7102-2d1d-466b-9866-efe7e405fd56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd839481-d623-4b8c-9668-6d56f6c21e69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[50847ae8-c3e2-455d-b365-48838508868e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:20:44 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:20:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[084e8d11-535f-4d9a-bf12-431d79019ff7]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG os_brick.utils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:20:44 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Updating existing volume attachment record: bdc74841-526a-4dd0-9e12-bf66db87d10e {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:20:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:47 user nova-compute[72426]: DEBUG nova.objects.instance [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'pci_requests' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:47 user nova-compute[72426]: DEBUG nova.objects.instance [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'numa_topology' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:20:47 user nova-compute[72426]: INFO nova.compute.claims [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Claim successful on node user
Aug 01 08:20:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:47 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:20:47 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:20:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.770s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:47 user nova-compute[72426]: INFO nova.network.neutron [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updating port 32122388-a2bc-410d-91f7-594b4702c6a0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 08:20:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:20:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquired lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:20:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:20:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-9386f141-81d4-4e02-b8e5-b2abb34e4c6f req-337dfda1-d6fd-48da-a5a4-09571f344539 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-changed-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-9386f141-81d4-4e02-b8e5-b2abb34e4c6f req-337dfda1-d6fd-48da-a5a4-09571f344539 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Refreshing instance network info cache due to event network-changed-32122388-a2bc-410d-91f7-594b4702c6a0. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:20:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9386f141-81d4-4e02-b8e5-b2abb34e4c6f req-337dfda1-d6fd-48da-a5a4-09571f344539 service nova] Acquiring lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:20:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updating instance_info_cache with network_info: [{"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:20:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Releasing lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:20:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:20:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Creating image(s)
Aug 01 08:20:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "/opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "/opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:49 user nova-compute[72426]: DEBUG nova.objects.instance [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'trusted_certs' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9386f141-81d4-4e02-b8e5-b2abb34e4c6f req-337dfda1-d6fd-48da-a5a4-09571f344539 service nova] Acquired lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:20:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-9386f141-81d4-4e02-b8e5-b2abb34e4c6f req-337dfda1-d6fd-48da-a5a4-09571f344539 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Refreshing network info cache for port 32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:20:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "e1c2fba15a25c26316aee0e34452291c5bec0d43" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "e1c2fba15a25c26316aee0e34452291c5bec0d43" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43.part --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43.part --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:50 user nova-compute[72426]: DEBUG nova.virt.images [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] ad84213f-4809-4776-8ba7-74f122f16830 was qcow2, converting to raw {{(pid=72426) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 08:20:50 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:20:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43.part /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43.converted {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-9386f141-81d4-4e02-b8e5-b2abb34e4c6f req-337dfda1-d6fd-48da-a5a4-09571f344539 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updated VIF entry in instance network info cache for port 32122388-a2bc-410d-91f7-594b4702c6a0. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:20:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-9386f141-81d4-4e02-b8e5-b2abb34e4c6f req-337dfda1-d6fd-48da-a5a4-09571f344539 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updating instance_info_cache with network_info: [{"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:20:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9386f141-81d4-4e02-b8e5-b2abb34e4c6f req-337dfda1-d6fd-48da-a5a4-09571f344539 service nova] Releasing lock "refresh_cache-a5e525d1-9cbd-4e92-8eea-f256b6edd86e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43.part /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43.converted" returned: 0 in 0.601s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43.converted --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43.converted --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "e1c2fba15a25c26316aee0e34452291c5bec0d43" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.891s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43 --force-share --output=json" returned: 0 in 0.164s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "e1c2fba15a25c26316aee0e34452291c5bec0d43" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "e1c2fba15a25c26316aee0e34452291c5bec0d43" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43 --force-share --output=json" returned: 0 in 0.236s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43,backing_fmt=raw /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43,backing_fmt=raw /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk 1073741824" returned: 0 in 0.060s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "e1c2fba15a25c26316aee0e34452291c5bec0d43" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1c2fba15a25c26316aee0e34452291c5bec0d43 --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG nova.objects.instance [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'migration_context' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:51 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Rebasing disk image.
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 -F raw /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:20:52 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Creating image(s)
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Ensure instance console log exists: /opt/stack/data/nova/instances/711f36c5-6692-4aec-b4fe-0aac97dfef12/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Start _get_guest_xml network_info=[{"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjYNpHBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '711f36c5-6692-4aec-b4fe-0aac97dfef12', 'attached_at': '', 'detached_at': '', 'volume_id': 'b265c54d-477a-4089-a4e6-78d137658f21', 'serial': 'b265c54d-477a-4089-a4e6-78d137658f21'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': 'bdc74841-526a-4dd0-9e12-bf66db87d10e', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:20:52 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 08:20:52 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:20:52 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'vcpu_model' on Instance uuid 711f36c5-6692-4aec-b4fe-0aac97dfef12 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjYNpHBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:20:53 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:53 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:53 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d883b62-271c-47f6-903c-feea7d719e43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:20:53 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e7cfa3-26f3-43b0-afdc-f8a5c8bebeb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21] added
Aug 01 08:20:53 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274ee66-f7c1-4db0-a199-14998ab2b343]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6718cad4-7f89-491b-8691-fc3836581be4]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjYNpHBM {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjYNpHBM" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e778b88-d53d-4557-922c-ab4940cff487]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mjYNpHBM'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6e3548-eb0e-4eec-bbc8-87c6c1a8f7f1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5086a609-11eb-4df4-a1b2-65706c4386e4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:20:53 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:20:53 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2fcdc9-032b-410e-ba8f-3652c78bc289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260]
Aug 01 08:20:53 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260] successful.
Aug 01 08:20:53 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.170s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a6b314-4a18-4ca1-8312-8cca61b0791f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4163a82e-c696-47a0-ae88-9d470a59ee8d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:53 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:20:53 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:53 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.538s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] HCTL ('39', '-', '-', 0) found on session 33 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.099s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[15412982-b178-4733-a2f8-f2ded8b32ebd]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:20:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjYNpHBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 -F raw /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk" returned: 0 in 2.583s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Ensure instance console log exists: /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Start _get_guest_xml network_info=[{"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6c542694fc1a163a8b0915ef0d46a87e',container_format='bare',created_at=2023-08-01T08:18:43Z,direct_url=<?>,disk_format='qcow2',id=ad84213f-4809-4776-8ba7-74f122f16830,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-120743636-shelved',owner='9a4cff1bbd5247afa9ed2ddf4db11738',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T08:18:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSaWvLBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a5e525d1-9cbd-4e92-8eea-f256b6edd86e', 'attached_at': '', 'detached_at': '', 'volume_id': '6dbe7101-ebfb-4dfa-8211-c6af5bf20173', 'serial': '6dbe7101-ebfb-4dfa-8211-c6af5bf20173'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '3a4daa07-19b9-46c4-80d0-09c259dc9559', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:20:54 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:20:54 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6c542694fc1a163a8b0915ef0d46a87e',container_format='bare',created_at=2023-08-01T08:18:43Z,direct_url=<?>,disk_format='qcow2',id=ad84213f-4809-4776-8ba7-74f122f16830,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-120743636-shelved',owner='9a4cff1bbd5247afa9ed2ddf4db11738',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T08:18:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.objects.instance [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'vcpu_model' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSaWvLBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:20:54 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.656s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] <== connect_volume: return (1657ms) {'type': 'block', 'scsi_wwn': '23335636466633966', 'path': '/dev/sdh'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335636466633966', 'path': '/dev/sdh'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.074s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:54 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:20:54 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54778de-ac60-4ec3-9942-1d488b6054fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:20:54 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-440152097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-386058360',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUuL6cIXOsVrN6GIqUyK3HSUIpRTiR6zIQsvQNqNDHMMOEkoFYsfvVw69PiuMAGsuyCOnnclpwgQI01DdYX76WXL3mjwTVlxrwB/mCjKb1sBbHecoDrcN2Zz6sELtcULg==',key_name='tempest-keypair-2041214637',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7be045e22d244d6984b171cd0345b6ec',ramdisk_id='',reservation_id='r-y0xq8j4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-328470853',owner_user_name='tempest-ServerActionsV293TestJSON-328470853-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3b164242dc4336889758526ddabd74',uuid=711f36c5-6692-4aec-b4fe-0aac97dfef12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converting VIF {"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:20:54 user nova-compute[72426]:   <uuid>711f36c5-6692-4aec-b4fe-0aac97dfef12</uuid>
Aug 01 08:20:54 user nova-compute[72426]:   <name>instance-0000001c</name>
Aug 01 08:20:54 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:20:54 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:20:54 user nova-compute[72426]:   <metadata>
Aug 01 08:20:54 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:20:54 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:20:54 user nova-compute[72426]:       <nova:name>tempest-ServerActionsV293TestJSON-server-440152097</nova:name>
Aug 01 08:20:54 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:20:52</nova:creationTime>
Aug 01 08:20:54 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:20:54 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:20:54 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:20:54 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:20:54 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:20:54 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:20:54 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:20:54 user nova-compute[72426]:       <nova:owner>
Aug 01 08:20:54 user nova-compute[72426]:         <nova:user uuid="0c3b164242dc4336889758526ddabd74">tempest-ServerActionsV293TestJSON-328470853-project-member</nova:user>
Aug 01 08:20:54 user nova-compute[72426]:         <nova:project uuid="7be045e22d244d6984b171cd0345b6ec">tempest-ServerActionsV293TestJSON-328470853</nova:project>
Aug 01 08:20:54 user nova-compute[72426]:       </nova:owner>
Aug 01 08:20:54 user nova-compute[72426]:       <nova:ports>
Aug 01 08:20:54 user nova-compute[72426]:         <nova:port uuid="e77776de-abb0-4125-bb7d-69f76d60d9f6">
Aug 01 08:20:54 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 08:20:54 user nova-compute[72426]:         </nova:port>
Aug 01 08:20:54 user nova-compute[72426]:       </nova:ports>
Aug 01 08:20:54 user nova-compute[72426]:     </nova:instance>
Aug 01 08:20:54 user nova-compute[72426]:   </metadata>
Aug 01 08:20:54 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:20:54 user nova-compute[72426]:     <system>
Aug 01 08:20:54 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:20:54 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:20:54 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:20:54 user nova-compute[72426]:       <entry name="serial">711f36c5-6692-4aec-b4fe-0aac97dfef12</entry>
Aug 01 08:20:54 user nova-compute[72426]:       <entry name="uuid">711f36c5-6692-4aec-b4fe-0aac97dfef12</entry>
Aug 01 08:20:54 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:20:54 user nova-compute[72426]:     </system>
Aug 01 08:20:54 user nova-compute[72426]:   </sysinfo>
Aug 01 08:20:54 user nova-compute[72426]:   <os>
Aug 01 08:20:54 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:20:54 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:20:54 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:20:54 user nova-compute[72426]:   </os>
Aug 01 08:20:54 user nova-compute[72426]:   <features>
Aug 01 08:20:54 user nova-compute[72426]:     <acpi/>
Aug 01 08:20:54 user nova-compute[72426]:     <apic/>
Aug 01 08:20:54 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:20:54 user nova-compute[72426]:   </features>
Aug 01 08:20:54 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:20:54 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:20:54 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:20:54 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:20:54 user nova-compute[72426]:   </clock>
Aug 01 08:20:54 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:20:54 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:20:54 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:20:54 user nova-compute[72426]:   </cpu>
Aug 01 08:20:54 user nova-compute[72426]:   <devices>
Aug 01 08:20:54 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:20:54 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:20:54 user nova-compute[72426]:       <source dev="/dev/sdh"/>
Aug 01 08:20:54 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:20:54 user nova-compute[72426]:       <serial>b265c54d-477a-4089-a4e6-78d137658f21</serial>
Aug 01 08:20:54 user nova-compute[72426]:     </disk>
Aug 01 08:20:54 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:20:54 user nova-compute[72426]:       <mac address="fa:16:3e:e7:2b:c2"/>
Aug 01 08:20:54 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:20:54 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:20:54 user nova-compute[72426]:       <target dev="tape77776de-ab"/>
Aug 01 08:20:54 user nova-compute[72426]:     </interface>
Aug 01 08:20:54 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:20:54 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/711f36c5-6692-4aec-b4fe-0aac97dfef12/console.log" append="off"/>
Aug 01 08:20:54 user nova-compute[72426]:     </serial>
Aug 01 08:20:54 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:20:54 user nova-compute[72426]:     <video>
Aug 01 08:20:54 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:20:54 user nova-compute[72426]:     </video>
Aug 01 08:20:54 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:20:54 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:20:54 user nova-compute[72426]:     </rng>
Aug 01 08:20:54 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:20:54 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:20:54 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:20:54 user nova-compute[72426]:     </memballoon>
Aug 01 08:20:54 user nova-compute[72426]:   </devices>
Aug 01 08:20:54 user nova-compute[72426]: </domain>
Aug 01 08:20:54 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-440152097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-386058360',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUuL6cIXOsVrN6GIqUyK3HSUIpRTiR6zIQsvQNqNDHMMOEkoFYsfvVw69PiuMAGsuyCOnnclpwgQI01DdYX76WXL3mjwTVlxrwB/mCjKb1sBbHecoDrcN2Zz6sELtcULg==',key_name='tempest-keypair-2041214637',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7be045e22d244d6984b171cd0345b6ec',ramdisk_id='',reservation_id='r-y0xq8j4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-328470853',owner_user_name='tempest-ServerActionsV293TestJSON-328470853-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3b164242dc4336889758526ddabd74',uuid=711f36c5-6692-4aec-b4fe-0aac97dfef12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converting VIF {"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_vif [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape77776de-ab, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape77776de-ab, col_values=(('external_ids', {'iface-id': 'e77776de-abb0-4125-bb7d-69f76d60d9f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:2b:c2', 'vm-uuid': '711f36c5-6692-4aec-b4fe-0aac97dfef12'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04271b8-c312-4c68-a5b0-3df0c8f5b8be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173] added
Aug 01 08:20:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:54 user nova-compute[72426]: INFO os_vif [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab')
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e3207f-f99c-4377-b389-c3c34cda9195]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[629b7383-5371-43d1-99fe-8fae36f3c228]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSaWvLBn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] No VIF found with MAC fa:16:3e:e7:2b:c2, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSaWvLBn" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b53bbf-234b-49f9-968c-61da212cd199]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hSaWvLBn'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[da45b1c6-710e-4502-a3f7-bbe8747d6251]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[10766831-6ea5-4a3e-bd91-eb767604f002]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:20:54 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[995ccfed-5fad-4aca-b419-1c0886ce6880]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173, portal: 172.16.0.220,3260]
Aug 01 08:20:54 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173, portal: 172.16.0.220,3260] successful.
Aug 01 08:20:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6354747-7438-49d9-852d-bafe4211cf87]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:20:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34d2413-36fd-4c54-a150-e61795b955f9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:20:55 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:20:55 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:20:55 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] HCTL ('40', '-', '-', 0) found on session 34 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[946df867-46af-42ae-b6fd-88772184a3d8]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:20:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Searching for a device in session 34 and hctl ['40', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Searching for a device in session 34 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSaWvLBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '26630346363373932', 'path': '/dev/sdi'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630346363373932', 'path': '/dev/sdi'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-120743636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-120743636',id=23,image_ref='ad84213f-4809-4776-8ba7-74f122f16830',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1007772321',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-kmty00m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member',shelved_at='2023-08-01T08:18:47.722872',shelved_host='user',shelved_image_id='ad84213f-4809-4776-8ba7-74f122f16830'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=a5e525d1-9cbd-4e92-8eea-f256b6edd86e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.objects.instance [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'pci_devices' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:20:56 user nova-compute[72426]:   <uuid>a5e525d1-9cbd-4e92-8eea-f256b6edd86e</uuid>
Aug 01 08:20:56 user nova-compute[72426]:   <name>instance-00000017</name>
Aug 01 08:20:56 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:20:56 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:20:56 user nova-compute[72426]:   <metadata>
Aug 01 08:20:56 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:20:56 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:20:56 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-120743636</nova:name>
Aug 01 08:20:56 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:20:54</nova:creationTime>
Aug 01 08:20:56 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:20:56 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:20:56 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:20:56 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:20:56 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:20:56 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:20:56 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:20:56 user nova-compute[72426]:       <nova:owner>
Aug 01 08:20:56 user nova-compute[72426]:         <nova:user uuid="f32fed5c40f24c2086d59cbb61f93bea">tempest-AttachVolumeShelveTestJSON-1854691353-project-member</nova:user>
Aug 01 08:20:56 user nova-compute[72426]:         <nova:project uuid="9a4cff1bbd5247afa9ed2ddf4db11738">tempest-AttachVolumeShelveTestJSON-1854691353</nova:project>
Aug 01 08:20:56 user nova-compute[72426]:       </nova:owner>
Aug 01 08:20:56 user nova-compute[72426]:       <nova:root type="image" uuid="ad84213f-4809-4776-8ba7-74f122f16830"/>
Aug 01 08:20:56 user nova-compute[72426]:       <nova:ports>
Aug 01 08:20:56 user nova-compute[72426]:         <nova:port uuid="32122388-a2bc-410d-91f7-594b4702c6a0">
Aug 01 08:20:56 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 08:20:56 user nova-compute[72426]:         </nova:port>
Aug 01 08:20:56 user nova-compute[72426]:       </nova:ports>
Aug 01 08:20:56 user nova-compute[72426]:     </nova:instance>
Aug 01 08:20:56 user nova-compute[72426]:   </metadata>
Aug 01 08:20:56 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:20:56 user nova-compute[72426]:     <system>
Aug 01 08:20:56 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:20:56 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:20:56 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:20:56 user nova-compute[72426]:       <entry name="serial">a5e525d1-9cbd-4e92-8eea-f256b6edd86e</entry>
Aug 01 08:20:56 user nova-compute[72426]:       <entry name="uuid">a5e525d1-9cbd-4e92-8eea-f256b6edd86e</entry>
Aug 01 08:20:56 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:20:56 user nova-compute[72426]:     </system>
Aug 01 08:20:56 user nova-compute[72426]:   </sysinfo>
Aug 01 08:20:56 user nova-compute[72426]:   <os>
Aug 01 08:20:56 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:20:56 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:20:56 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:20:56 user nova-compute[72426]:   </os>
Aug 01 08:20:56 user nova-compute[72426]:   <features>
Aug 01 08:20:56 user nova-compute[72426]:     <acpi/>
Aug 01 08:20:56 user nova-compute[72426]:     <apic/>
Aug 01 08:20:56 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:20:56 user nova-compute[72426]:   </features>
Aug 01 08:20:56 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:20:56 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:20:56 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:20:56 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:20:56 user nova-compute[72426]:   </clock>
Aug 01 08:20:56 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:20:56 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:20:56 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:20:56 user nova-compute[72426]:   </cpu>
Aug 01 08:20:56 user nova-compute[72426]:   <devices>
Aug 01 08:20:56 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:20:56 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:20:56 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk"/>
Aug 01 08:20:56 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:20:56 user nova-compute[72426]:     </disk>
Aug 01 08:20:56 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:20:56 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:20:56 user nova-compute[72426]:       <source dev="/dev/sdi"/>
Aug 01 08:20:56 user nova-compute[72426]:       <target dev="vdc" bus="virtio"/>
Aug 01 08:20:56 user nova-compute[72426]:       <serial>6dbe7101-ebfb-4dfa-8211-c6af5bf20173</serial>
Aug 01 08:20:56 user nova-compute[72426]:     </disk>
Aug 01 08:20:56 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:20:56 user nova-compute[72426]:       <mac address="fa:16:3e:a7:2e:e2"/>
Aug 01 08:20:56 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:20:56 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:20:56 user nova-compute[72426]:       <target dev="tap32122388-a2"/>
Aug 01 08:20:56 user nova-compute[72426]:     </interface>
Aug 01 08:20:56 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:20:56 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/console.log" append="off"/>
Aug 01 08:20:56 user nova-compute[72426]:     </serial>
Aug 01 08:20:56 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:20:56 user nova-compute[72426]:     <video>
Aug 01 08:20:56 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:20:56 user nova-compute[72426]:     </video>
Aug 01 08:20:56 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:20:56 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:20:56 user nova-compute[72426]:     </rng>
Aug 01 08:20:56 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:20:56 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:20:56 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:20:56 user nova-compute[72426]:     </memballoon>
Aug 01 08:20:56 user nova-compute[72426]:   </devices>
Aug 01 08:20:56 user nova-compute[72426]: </domain>
Aug 01 08:20:56 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-120743636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-120743636',id=23,image_ref='ad84213f-4809-4776-8ba7-74f122f16830',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1007772321',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-kmty00m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member',shelved_at='2023-08-01T08:18:47.722872',shelved_host='user',shelved_image_id='ad84213f-4809-4776-8ba7-74f122f16830'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=a5e525d1-9cbd-4e92-8eea-f256b6edd86e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG os_vif [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32122388-a2, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32122388-a2, col_values=(('external_ids', {'iface-id': '32122388-a2bc-410d-91f7-594b4702c6a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:2e:e2', 'vm-uuid': 'a5e525d1-9cbd-4e92-8eea-f256b6edd86e'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:56 user nova-compute[72426]: INFO os_vif [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2')
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] No VIF found with MAC fa:16:3e:a7:2e:e2, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-df4b74b2-14e0-444e-8b75-1efe3398881c req-49d4c081-d236-427f-90c6-7e068827c720 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-df4b74b2-14e0-444e-8b75-1efe3398881c req-49d4c081-d236-427f-90c6-7e068827c720 service nova] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-df4b74b2-14e0-444e-8b75-1efe3398881c req-49d4c081-d236-427f-90c6-7e068827c720 service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-df4b74b2-14e0-444e-8b75-1efe3398881c req-49d4c081-d236-427f-90c6-7e068827c720 service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-df4b74b2-14e0-444e-8b75-1efe3398881c req-49d4c081-d236-427f-90c6-7e068827c720 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] No waiting events found dispatching network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:56 user nova-compute[72426]: WARNING nova.compute.manager [req-df4b74b2-14e0-444e-8b75-1efe3398881c req-49d4c081-d236-427f-90c6-7e068827c720 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received unexpected event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] No waiting events found dispatching network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:58 user nova-compute[72426]: WARNING nova.compute.manager [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received unexpected event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 08:20:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:58 user nova-compute[72426]: WARNING nova.compute.manager [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received unexpected event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 08:20:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:20:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:20:58 user nova-compute[72426]: WARNING nova.compute.manager [req-58c3bee9-d991-46ed-bc56-126e217c9653 req-d9970905-e028-4761-91e4-87308ddad26d service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received unexpected event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878059.3185449, 711f36c5-6692-4aec-b4fe-0aac97dfef12 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:20:59 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] VM Resumed (Lifecycle Event)
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:20:59 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Instance spawned successfully.
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:20:59 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878059.3240077, 711f36c5-6692-4aec-b4fe-0aac97dfef12 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:20:59 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] VM Started (Lifecycle Event)
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:20:59 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72426) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 08:20:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8d065bd7-76e3-4dd2-b40b-718202bfa987 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:00 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878060.0036256, a5e525d1-9cbd-4e92-8eea-f256b6edd86e => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:21:00 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] VM Resumed (Lifecycle Event)
Aug 01 08:21:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:21:00 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:21:00 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Instance spawned successfully.
Aug 01 08:21:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:21:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:21:00 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:21:00 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878060.007677, a5e525d1-9cbd-4e92-8eea-f256b6edd86e => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:21:00 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] VM Started (Lifecycle Event)
Aug 01 08:21:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:21:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:21:00 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:21:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:21:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-88c0ae46-b672-4b7f-bb40-58d6c192c46c tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.559s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "2572e472-73fe-4e5a-b486-e38274a978d7" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:11 user nova-compute[72426]: DEBUG nova.compute.manager [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Going to confirm migration 2 {{(pid=72426) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 01 08:21:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:21:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquired lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:21:11 user nova-compute[72426]: DEBUG nova.network.neutron [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:21:11 user nova-compute[72426]: DEBUG nova.objects.instance [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'info_cache' on Instance uuid 2572e472-73fe-4e5a-b486-e38274a978d7 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:12 user nova-compute[72426]: DEBUG nova.network.neutron [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating instance_info_cache with network_info: [{"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:21:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Releasing lock "refresh_cache-2572e472-73fe-4e5a-b486-e38274a978d7" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:21:12 user nova-compute[72426]: DEBUG nova.objects.instance [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'migration_context' on Instance uuid 2572e472-73fe-4e5a-b486-e38274a978d7 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:12 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:21:13 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:21:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.588s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:13 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Deleted allocation for migration cfdcf0f0-2e1d-4ef4-94b9-7e75c2b4b466
Aug 01 08:21:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318b40b3-c59f-4de3-ab73-4d01abb9396c tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "2572e472-73fe-4e5a-b486-e38274a978d7" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.587s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:15 user nova-compute[72426]: DEBUG nova.compute.manager [req-25618b55-a2d3-48e8-977a-a85fc093c4b1 req-1bd150aa-7fee-4529-8f7f-6cf89c4d2ca2 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received event network-changed-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:15 user nova-compute[72426]: DEBUG nova.compute.manager [req-25618b55-a2d3-48e8-977a-a85fc093c4b1 req-1bd150aa-7fee-4529-8f7f-6cf89c4d2ca2 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Refreshing instance network info cache due to event network-changed-e423bc05-c489-41d1-bbc6-2554c36b6abe. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:21:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-25618b55-a2d3-48e8-977a-a85fc093c4b1 req-1bd150aa-7fee-4529-8f7f-6cf89c4d2ca2 service nova] Acquiring lock "refresh_cache-6dd67de0-9c20-48ce-a73c-1a0092bca1a3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:21:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-25618b55-a2d3-48e8-977a-a85fc093c4b1 req-1bd150aa-7fee-4529-8f7f-6cf89c4d2ca2 service nova] Acquired lock "refresh_cache-6dd67de0-9c20-48ce-a73c-1a0092bca1a3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:21:15 user nova-compute[72426]: DEBUG nova.network.neutron [req-25618b55-a2d3-48e8-977a-a85fc093c4b1 req-1bd150aa-7fee-4529-8f7f-6cf89c4d2ca2 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Refreshing network info cache for port e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG nova.network.neutron [req-25618b55-a2d3-48e8-977a-a85fc093c4b1 req-1bd150aa-7fee-4529-8f7f-6cf89c4d2ca2 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Updated VIF entry in instance network info cache for port e423bc05-c489-41d1-bbc6-2554c36b6abe. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG nova.network.neutron [req-25618b55-a2d3-48e8-977a-a85fc093c4b1 req-1bd150aa-7fee-4529-8f7f-6cf89c4d2ca2 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Updating instance_info_cache with network_info: [{"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-25618b55-a2d3-48e8-977a-a85fc093c4b1 req-1bd150aa-7fee-4529-8f7f-6cf89c4d2ca2 service nova] Releasing lock "refresh_cache-6dd67de0-9c20-48ce-a73c-1a0092bca1a3" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:16 user nova-compute[72426]: INFO nova.compute.manager [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Terminating instance
Aug 01 08:21:16 user nova-compute[72426]: DEBUG nova.compute.manager [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-dcb1bbe8-67d3-455a-a4d7-6ed79c829683 req-c7ae6fdb-2baa-4156-a0ec-831812cb174c service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received event network-vif-unplugged-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dcb1bbe8-67d3-455a-a4d7-6ed79c829683 req-c7ae6fdb-2baa-4156-a0ec-831812cb174c service nova] Acquiring lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dcb1bbe8-67d3-455a-a4d7-6ed79c829683 req-c7ae6fdb-2baa-4156-a0ec-831812cb174c service nova] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-dcb1bbe8-67d3-455a-a4d7-6ed79c829683 req-c7ae6fdb-2baa-4156-a0ec-831812cb174c service nova] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-dcb1bbe8-67d3-455a-a4d7-6ed79c829683 req-c7ae6fdb-2baa-4156-a0ec-831812cb174c service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] No waiting events found dispatching network-vif-unplugged-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:21:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-dcb1bbe8-67d3-455a-a4d7-6ed79c829683 req-c7ae6fdb-2baa-4156-a0ec-831812cb174c service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received event network-vif-unplugged-e423bc05-c489-41d1-bbc6-2554c36b6abe for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:21:17 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Instance destroyed successfully.
Aug 01 08:21:17 user nova-compute[72426]: DEBUG nova.objects.instance [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lazy-loading 'resources' on Instance uuid 6dd67de0-9c20-48ce-a73c-1a0092bca1a3 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1696646090',display_name='tempest-TestVolumeBootPattern-server-1696646090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1696646090',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwAhreXMhTB8T7LTS3WDX6kRgXb9BnVYEZYQPoF5FGH3bUHuQnuMUueZ+xzRUaxNgyiXc9pf2QAsQhWnhK9+E2tjM6RN1qVUihVAZ+qSqWDvdICQ1ao5vxLw9JyWyV35g==',key_name='tempest-TestVolumeBootPattern-315952015',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:19:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-qqltch17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:19:38Z,user_data=None,user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=6dd67de0-9c20-48ce-a73c-1a0092bca1a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "address": "fa:16:3e:0e:18:e8", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape423bc05-c4", "ovs_interfaceid": "e423bc05-c489-41d1-bbc6-2554c36b6abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=e423bc05-c489-41d1-bbc6-2554c36b6abe,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape423bc05-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_vif [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=e423bc05-c489-41d1-bbc6-2554c36b6abe,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape423bc05-c4') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape423bc05-c4, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:17 user nova-compute[72426]: INFO os_vif [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:18:e8,bridge_name='br-int',has_traffic_filtering=True,id=e423bc05-c489-41d1-bbc6-2554c36b6abe,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape423bc05-c4')
Aug 01 08:21:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGCRnFkb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:21:17 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c7cb06-c739-4f62-b71b-4be25906017b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15168b6-aa3f-4aad-87c2-d59955d7fb84]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:21:17 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:21:17 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:21:17 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c3f5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0994a40c-e6a0-4951-8de7-6200ca119982]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37b4a65-2a4c-4e3f-9a83-0fb2a4dd5040]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1195502-e5d5-4114-ac37-08d00eb9bd46]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[beac06ba-a429-4c1c-a508-9ff670838d8d]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8dce0fa', '/dev/disk/by-id/scsi-1SCST_BIO8dce0fa-7ef9fc844f204bc5', '/dev/disk/by-id/scsi-23765663966633834') {{(pid=83442) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd8b8ee-24dd-4790-a55d-6ab6d32fdc23]: (4, None) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40a014a-782a-4afb-93b4-8f0bfb2d7a06]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8e9fbb-156b-4798-ba39-ac0010538253]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b, portal: 172.16.0.220,3260]
Aug 01 08:21:17 user nova-compute[72426]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b, portal: 172.16.0.220,3260] successful.
Aug 01 08:21:17 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf389d0d-65da-4a2d-839e-ffce4df34e80]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== disconnect_volume: return (362ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:21:17 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Deleting instance files /opt/stack/data/nova/instances/6dd67de0-9c20-48ce-a73c-1a0092bca1a3_del
Aug 01 08:21:17 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Deletion of /opt/stack/data/nova/instances/6dd67de0-9c20-48ce-a73c-1a0092bca1a3_del complete
Aug 01 08:21:17 user nova-compute[72426]: INFO nova.compute.manager [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 01 08:21:17 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:21:17 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:21:18 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:21:18 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Took 0.90 seconds to deallocate network for instance.
Aug 01 08:21:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-a42e57d6-d350-45ff-825e-7bdf647935dc req-a05597e3-980c-4b9d-a84e-3426e94caeb6 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received event network-vif-deleted-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:18 user nova-compute[72426]: INFO nova.compute.manager [req-a42e57d6-d350-45ff-825e-7bdf647935dc req-a05597e3-980c-4b9d-a84e-3426e94caeb6 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Neutron deleted interface e423bc05-c489-41d1-bbc6-2554c36b6abe; detaching it from the instance and deleting it from the info cache
Aug 01 08:21:18 user nova-compute[72426]: DEBUG nova.network.neutron [req-a42e57d6-d350-45ff-825e-7bdf647935dc req-a05597e3-980c-4b9d-a84e-3426e94caeb6 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:21:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-a42e57d6-d350-45ff-825e-7bdf647935dc req-a05597e3-980c-4b9d-a84e-3426e94caeb6 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Detach interface failed, port_id=e423bc05-c489-41d1-bbc6-2554c36b6abe, reason: Instance 6dd67de0-9c20-48ce-a73c-1a0092bca1a3 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:21:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-85f8f4ec-acb8-42ea-b8dc-8f41ebbcac00 req-ad275957-04fa-48ed-bf41-272a31ba3405 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received event network-vif-plugged-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-85f8f4ec-acb8-42ea-b8dc-8f41ebbcac00 req-ad275957-04fa-48ed-bf41-272a31ba3405 service nova] Acquiring lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-85f8f4ec-acb8-42ea-b8dc-8f41ebbcac00 req-ad275957-04fa-48ed-bf41-272a31ba3405 service nova] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-85f8f4ec-acb8-42ea-b8dc-8f41ebbcac00 req-ad275957-04fa-48ed-bf41-272a31ba3405 service nova] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-85f8f4ec-acb8-42ea-b8dc-8f41ebbcac00 req-ad275957-04fa-48ed-bf41-272a31ba3405 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] No waiting events found dispatching network-vif-plugged-e423bc05-c489-41d1-bbc6-2554c36b6abe {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:21:18 user nova-compute[72426]: WARNING nova.compute.manager [req-85f8f4ec-acb8-42ea-b8dc-8f41ebbcac00 req-ad275957-04fa-48ed-bf41-272a31ba3405 service nova] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Received unexpected event network-vif-plugged-e423bc05-c489-41d1-bbc6-2554c36b6abe for instance with vm_state active and task_state deleting.
Aug 01 08:21:19 user nova-compute[72426]: INFO nova.compute.manager [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Took 0.91 seconds to detach 1 volumes for instance.
Aug 01 08:21:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:19 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:21:19 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:21:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:19 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Deleted allocations for instance 6dd67de0-9c20-48ce-a73c-1a0092bca1a3
Aug 01 08:21:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aa98dc37-c80d-48d9-a877-609fa043964b tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "6dd67de0-9c20-48ce-a73c-1a0092bca1a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.893s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:21:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:21:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:21:30 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:21:30 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=6797MB free_disk=25.290794372558594GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 73fb06b8-0824-42fc-bbfd-6914bdb78824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance adcf2dea-a758-4e13-9091-fffa6339f670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance e1119088-18c7-483d-a89d-3b5d19054e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 711f36c5-6692-4aec-b4fe-0aac97dfef12 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 05637642-f020-48af-b44a-d48e25a598fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2572e472-73fe-4e5a-b486-e38274a978d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance b4d8cd69-296b-4253-badc-75e771af39b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:21:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:21:31 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:21:31 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:21:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:21:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:32 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878077.103912, 6dd67de0-9c20-48ce-a73c-1a0092bca1a3 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:21:32 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] VM Stopped (Lifecycle Event)
Aug 01 08:21:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-cdbbcb38-8082-4ed3-a0be-cbab8593f294 None None] [instance: 6dd67de0-9c20-48ce-a73c-1a0092bca1a3] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:21:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:21:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:21:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:21:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:21:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:21:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:21:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:21:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:21:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:21:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:21:36 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:21:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:36 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:21:36 user nova-compute[72426]: INFO nova.compute.claims [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Claim successful on node user
Aug 01 08:21:36 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:21:36 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.network.neutron [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:21:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.policy [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56d58ffe9bad4d1fb35367ac0e60d181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff89c616cbd48e685d1d4330c874bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:21:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Creating image(s)
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "/opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "/opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "/opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk 1073741824" returned: 0 in 0.051s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.network.neutron [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Successfully created port: 95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Cannot resize image /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.objects.instance [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'migration_context' on Instance uuid 37dab412-5a15-46e8-844e-2ef0c03b7181 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Ensure instance console log exists: /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Successfully updated port: 95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquired lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-8fc527fd-8cf6-4bdc-9092-bf933b5f0a4e req-cc732b80-fbdf-4479-89f9-17971bd91650 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received event network-changed-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-8fc527fd-8cf6-4bdc-9092-bf933b5f0a4e req-cc732b80-fbdf-4479-89f9-17971bd91650 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Refreshing instance network info cache due to event network-changed-95cc6db7-744d-477c-b1d4-31ed03169092. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8fc527fd-8cf6-4bdc-9092-bf933b5f0a4e req-cc732b80-fbdf-4479-89f9-17971bd91650 service nova] Acquiring lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updating instance_info_cache with network_info: [{"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Releasing lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.compute.manager [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Instance network_info: |[{"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8fc527fd-8cf6-4bdc-9092-bf933b5f0a4e req-cc732b80-fbdf-4479-89f9-17971bd91650 service nova] Acquired lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.network.neutron [req-8fc527fd-8cf6-4bdc-9092-bf933b5f0a4e req-cc732b80-fbdf-4479-89f9-17971bd91650 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Refreshing network info cache for port 95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Start _get_guest_xml network_info=[{"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:21:38 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:21:38 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1655660679',display_name='tempest-TestStampPattern-server-1655660679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1655660679',id=32,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzi07fWEZm9ZDpMiwLaYbjLSFJSACGngqPGH6IXGkKdZqaHEkFII80iFN525qE1V6pVTrPP41DJXrIqlOvHoD2AT4HCLJUUwmYLnWGEElwg4L0QUNN1qgp0PiMSAfYWeA==',key_name='tempest-TestStampPattern-721892585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ff89c616cbd48e685d1d4330c874bb7',ramdisk_id='',reservation_id='r-yedwg8jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-936652585',owner_user_name='tempest-TestStampPattern-936652585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:21:37Z,user_data=None,user_id='56d58ffe9bad4d1fb35367ac0e60d181',uuid=37dab412-5a15-46e8-844e-2ef0c03b7181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converting VIF {"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2f:46,bridge_name='br-int',has_traffic_filtering=True,id=95cc6db7-744d-477c-b1d4-31ed03169092,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc6db7-74') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:21:38 user nova-compute[72426]: DEBUG nova.objects.instance [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'pci_devices' on Instance uuid 37dab412-5a15-46e8-844e-2ef0c03b7181 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:21:39 user nova-compute[72426]:   <uuid>37dab412-5a15-46e8-844e-2ef0c03b7181</uuid>
Aug 01 08:21:39 user nova-compute[72426]:   <name>instance-00000020</name>
Aug 01 08:21:39 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:21:39 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:21:39 user nova-compute[72426]:   <metadata>
Aug 01 08:21:39 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:21:39 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:21:39 user nova-compute[72426]:       <nova:name>tempest-TestStampPattern-server-1655660679</nova:name>
Aug 01 08:21:39 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:21:38</nova:creationTime>
Aug 01 08:21:39 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:21:39 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:21:39 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:21:39 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:21:39 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:21:39 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:21:39 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:21:39 user nova-compute[72426]:       <nova:owner>
Aug 01 08:21:39 user nova-compute[72426]:         <nova:user uuid="56d58ffe9bad4d1fb35367ac0e60d181">tempest-TestStampPattern-936652585-project-member</nova:user>
Aug 01 08:21:39 user nova-compute[72426]:         <nova:project uuid="1ff89c616cbd48e685d1d4330c874bb7">tempest-TestStampPattern-936652585</nova:project>
Aug 01 08:21:39 user nova-compute[72426]:       </nova:owner>
Aug 01 08:21:39 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:21:39 user nova-compute[72426]:       <nova:ports>
Aug 01 08:21:39 user nova-compute[72426]:         <nova:port uuid="95cc6db7-744d-477c-b1d4-31ed03169092">
Aug 01 08:21:39 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 08:21:39 user nova-compute[72426]:         </nova:port>
Aug 01 08:21:39 user nova-compute[72426]:       </nova:ports>
Aug 01 08:21:39 user nova-compute[72426]:     </nova:instance>
Aug 01 08:21:39 user nova-compute[72426]:   </metadata>
Aug 01 08:21:39 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:21:39 user nova-compute[72426]:     <system>
Aug 01 08:21:39 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:21:39 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:21:39 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:21:39 user nova-compute[72426]:       <entry name="serial">37dab412-5a15-46e8-844e-2ef0c03b7181</entry>
Aug 01 08:21:39 user nova-compute[72426]:       <entry name="uuid">37dab412-5a15-46e8-844e-2ef0c03b7181</entry>
Aug 01 08:21:39 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:21:39 user nova-compute[72426]:     </system>
Aug 01 08:21:39 user nova-compute[72426]:   </sysinfo>
Aug 01 08:21:39 user nova-compute[72426]:   <os>
Aug 01 08:21:39 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:21:39 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:21:39 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:21:39 user nova-compute[72426]:   </os>
Aug 01 08:21:39 user nova-compute[72426]:   <features>
Aug 01 08:21:39 user nova-compute[72426]:     <acpi/>
Aug 01 08:21:39 user nova-compute[72426]:     <apic/>
Aug 01 08:21:39 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:21:39 user nova-compute[72426]:   </features>
Aug 01 08:21:39 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:21:39 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:21:39 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:21:39 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:21:39 user nova-compute[72426]:   </clock>
Aug 01 08:21:39 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:21:39 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:21:39 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:21:39 user nova-compute[72426]:   </cpu>
Aug 01 08:21:39 user nova-compute[72426]:   <devices>
Aug 01 08:21:39 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:21:39 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:21:39 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk"/>
Aug 01 08:21:39 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:21:39 user nova-compute[72426]:     </disk>
Aug 01 08:21:39 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:21:39 user nova-compute[72426]:       <mac address="fa:16:3e:bb:2f:46"/>
Aug 01 08:21:39 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:21:39 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:21:39 user nova-compute[72426]:       <target dev="tap95cc6db7-74"/>
Aug 01 08:21:39 user nova-compute[72426]:     </interface>
Aug 01 08:21:39 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:21:39 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/console.log" append="off"/>
Aug 01 08:21:39 user nova-compute[72426]:     </serial>
Aug 01 08:21:39 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:21:39 user nova-compute[72426]:     <video>
Aug 01 08:21:39 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:21:39 user nova-compute[72426]:     </video>
Aug 01 08:21:39 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:21:39 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:21:39 user nova-compute[72426]:     </rng>
Aug 01 08:21:39 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:21:39 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:21:39 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:21:39 user nova-compute[72426]:     </memballoon>
Aug 01 08:21:39 user nova-compute[72426]:   </devices>
Aug 01 08:21:39 user nova-compute[72426]: </domain>
Aug 01 08:21:39 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1655660679',display_name='tempest-TestStampPattern-server-1655660679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1655660679',id=32,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzi07fWEZm9ZDpMiwLaYbjLSFJSACGngqPGH6IXGkKdZqaHEkFII80iFN525qE1V6pVTrPP41DJXrIqlOvHoD2AT4HCLJUUwmYLnWGEElwg4L0QUNN1qgp0PiMSAfYWeA==',key_name='tempest-TestStampPattern-721892585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ff89c616cbd48e685d1d4330c874bb7',ramdisk_id='',reservation_id='r-yedwg8jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-936652585',owner_user_name='tempest-TestStampPattern-936652585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:21:37Z,user_data=None,user_id='56d58ffe9bad4d1fb35367ac0e60d181',uuid=37dab412-5a15-46e8-844e-2ef0c03b7181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converting VIF {"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2f:46,bridge_name='br-int',has_traffic_filtering=True,id=95cc6db7-744d-477c-b1d4-31ed03169092,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc6db7-74') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG os_vif [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2f:46,bridge_name='br-int',has_traffic_filtering=True,id=95cc6db7-744d-477c-b1d4-31ed03169092,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc6db7-74') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95cc6db7-74, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95cc6db7-74, col_values=(('external_ids', {'iface-id': '95cc6db7-744d-477c-b1d4-31ed03169092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:2f:46', 'vm-uuid': '37dab412-5a15-46e8-844e-2ef0c03b7181'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:39 user nova-compute[72426]: INFO os_vif [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2f:46,bridge_name='br-int',has_traffic_filtering=True,id=95cc6db7-744d-477c-b1d4-31ed03169092,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc6db7-74')
Aug 01 08:21:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] No VIF found with MAC fa:16:3e:bb:2f:46, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG nova.network.neutron [req-8fc527fd-8cf6-4bdc-9092-bf933b5f0a4e req-cc732b80-fbdf-4479-89f9-17971bd91650 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updated VIF entry in instance network info cache for port 95cc6db7-744d-477c-b1d4-31ed03169092. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG nova.network.neutron [req-8fc527fd-8cf6-4bdc-9092-bf933b5f0a4e req-cc732b80-fbdf-4479-89f9-17971bd91650 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updating instance_info_cache with network_info: [{"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:21:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8fc527fd-8cf6-4bdc-9092-bf933b5f0a4e req-cc732b80-fbdf-4479-89f9-17971bd91650 service nova] Releasing lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:21:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-192f097a-3979-472d-bacf-7be0cad1df05 req-980f9dd7-86df-49ea-8534-0068f3dd2be7 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received event network-vif-plugged-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-192f097a-3979-472d-bacf-7be0cad1df05 req-980f9dd7-86df-49ea-8534-0068f3dd2be7 service nova] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-192f097a-3979-472d-bacf-7be0cad1df05 req-980f9dd7-86df-49ea-8534-0068f3dd2be7 service nova] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-192f097a-3979-472d-bacf-7be0cad1df05 req-980f9dd7-86df-49ea-8534-0068f3dd2be7 service nova] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-192f097a-3979-472d-bacf-7be0cad1df05 req-980f9dd7-86df-49ea-8534-0068f3dd2be7 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] No waiting events found dispatching network-vif-plugged-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:21:40 user nova-compute[72426]: WARNING nova.compute.manager [req-192f097a-3979-472d-bacf-7be0cad1df05 req-980f9dd7-86df-49ea-8534-0068f3dd2be7 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received unexpected event network-vif-plugged-95cc6db7-744d-477c-b1d4-31ed03169092 for instance with vm_state building and task_state spawning.
Aug 01 08:21:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878102.5109217, 37dab412-5a15-46e8-844e-2ef0c03b7181 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:21:42 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] VM Resumed (Lifecycle Event)
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:21:42 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Instance spawned successfully.
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:21:42 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878102.5141687, 37dab412-5a15-46e8-844e-2ef0c03b7181 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:21:42 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] VM Started (Lifecycle Event)
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:21:42 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:21:42 user nova-compute[72426]: INFO nova.compute.manager [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Took 5.41 seconds to spawn the instance on the hypervisor.
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.compute.manager [req-8bab262d-1b85-4631-b6c7-13395343fabe req-c2a3c3d6-7d6b-4835-94a8-867e4f7ddecb service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received event network-vif-plugged-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8bab262d-1b85-4631-b6c7-13395343fabe req-c2a3c3d6-7d6b-4835-94a8-867e4f7ddecb service nova] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8bab262d-1b85-4631-b6c7-13395343fabe req-c2a3c3d6-7d6b-4835-94a8-867e4f7ddecb service nova] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8bab262d-1b85-4631-b6c7-13395343fabe req-c2a3c3d6-7d6b-4835-94a8-867e4f7ddecb service nova] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.compute.manager [req-8bab262d-1b85-4631-b6c7-13395343fabe req-c2a3c3d6-7d6b-4835-94a8-867e4f7ddecb service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] No waiting events found dispatching network-vif-plugged-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:21:42 user nova-compute[72426]: WARNING nova.compute.manager [req-8bab262d-1b85-4631-b6c7-13395343fabe req-c2a3c3d6-7d6b-4835-94a8-867e4f7ddecb service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received unexpected event network-vif-plugged-95cc6db7-744d-477c-b1d4-31ed03169092 for instance with vm_state building and task_state spawning.
Aug 01 08:21:42 user nova-compute[72426]: INFO nova.compute.manager [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Took 6.27 seconds to build instance.
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-49555d26-d768-4077-91bf-9b09a5b7b5b4 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.429s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquired lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:21:42 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'info_cache' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Updating instance_info_cache with network_info: [{"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Releasing lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:21:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance destroyed successfully.
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'resources' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-786606183',display_name='tempest-AttachVolumeTestJSON-server-786606183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-786606183',id=27,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhMcMLFpWRtcugrzk5/raTjStSXB9ipq79Xl+iZRLvhAJzQsUrNTa4A33Y+LFLAJhexCpWGTXgzOp8ywgg15r2gAc8AxCfNY7zz3j9aWRNC0qS56zJkCjoe3hYKglRjfQ==',key_name='tempest-keypair-1553423732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-rcziynoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=e1119088-18c7-483d-a89d-3b5d19054e52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_vif [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f0b410f-c4, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:21:43 user nova-compute[72426]: INFO os_vif [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4')
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtroyQLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:21:43 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9f2025-0f22-48c3-b670-c67794d501d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e0e32-c81f-42c1-a59f-3797831e99e1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:21:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:21:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38c02d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e'): ({'sdg'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Removing single pathed devices sdg {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d81383-3a2b-4207-b8d0-3e4d97f89c6c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b2e354-f70c-45af-9b5b-87b61c48c04f]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flushing IO for device /dev/sdg {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[296825c0-b7f7-4fde-b79e-d2621d9850d7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[94548d76-77b3-40fa-9c60-37b8c885c81f]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] SCSI volumes sdg have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[158ff420-2e80-4b14-b6e4-a42e82215ce7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9174004a-5ec2-422d-850a-e01a2cf868ee]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260]
Aug 01 08:21:43 user nova-compute[72426]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260] successful.
Aug 01 08:21:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc4fe4e-be5d-4960-9381-4c2fe19f5992]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== disconnect_volume: return (306ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Start _get_guest_xml network_info=[{"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtroyQLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'e1119088-18c7-483d-a89d-3b5d19054e52', 'attached_at': '', 'detached_at': '', 'volume_id': 'de3d896b-64bc-473a-a1d3-090164bd228e', 'serial': 'de3d896b-64bc-473a-a1d3-090164bd228e'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '8889d195-adae-4d36-a66e-0dc2894fae61', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'numa_topology' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:43 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:21:43 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtroyQLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:21:43 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:21:43 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:21:43 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe22540-46b8-4488-b592-236b28140be1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:21:43 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[15211ced-3637-4612-afae-190722643502]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e] added
Aug 01 08:21:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c558bbca-82a6-42ad-a646-af5fb4dd40f7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d353ff8a-3ae3-4919-8c7f-63e66305bf87]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtroyQLi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtroyQLi" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f5f7b9-ab6d-4ab7-83a9-11c92292f354]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtroyQLi'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8c086e-b9e3-4034-b343-62a412fd04e9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc88bcb-0979-4e95-a033-d61acc786aa7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:21:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:21:43 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:21:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:21:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[602aa201-4a7b-459f-957e-0cd17205755f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260]
Aug 01 08:21:44 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260] successful.
Aug 01 08:21:44 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c18e4f0-8675-4dbc-8a83-8de756d2d298]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc89f7cb-b30c-47c6-91f4-fad5dccbead2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:21:44 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:21:44 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:21:44 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21733be-3a61-4dba-b13b-798b63b0d894]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:21:44 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtroyQLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23761663837336465', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761663837336465', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-786606183',display_name='tempest-AttachVolumeTestJSON-server-786606183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-786606183',id=27,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhMcMLFpWRtcugrzk5/raTjStSXB9ipq79Xl+iZRLvhAJzQsUrNTa4A33Y+LFLAJhexCpWGTXgzOp8ywgg15r2gAc8AxCfNY7zz3j9aWRNC0qS56zJkCjoe3hYKglRjfQ==',key_name='tempest-keypair-1553423732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-rcziynoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=e1119088-18c7-483d-a89d-3b5d19054e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'pci_devices' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:21:45 user nova-compute[72426]:   <uuid>e1119088-18c7-483d-a89d-3b5d19054e52</uuid>
Aug 01 08:21:45 user nova-compute[72426]:   <name>instance-0000001b</name>
Aug 01 08:21:45 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:21:45 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:21:45 user nova-compute[72426]:   <metadata>
Aug 01 08:21:45 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:21:45 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:21:45 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeTestJSON-server-786606183</nova:name>
Aug 01 08:21:45 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:21:43</nova:creationTime>
Aug 01 08:21:45 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:21:45 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:21:45 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:21:45 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:21:45 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:21:45 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:21:45 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:21:45 user nova-compute[72426]:       <nova:owner>
Aug 01 08:21:45 user nova-compute[72426]:         <nova:user uuid="aab05095eb5347ea9f7e4f7bf33a089a">tempest-AttachVolumeTestJSON-173754033-project-member</nova:user>
Aug 01 08:21:45 user nova-compute[72426]:         <nova:project uuid="f4d025ba4c824773bbeedb7981910a9a">tempest-AttachVolumeTestJSON-173754033</nova:project>
Aug 01 08:21:45 user nova-compute[72426]:       </nova:owner>
Aug 01 08:21:45 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:21:45 user nova-compute[72426]:       <nova:ports>
Aug 01 08:21:45 user nova-compute[72426]:         <nova:port uuid="9f0b410f-c412-4817-9db3-b9ec5ffe8c09">
Aug 01 08:21:45 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 08:21:45 user nova-compute[72426]:         </nova:port>
Aug 01 08:21:45 user nova-compute[72426]:       </nova:ports>
Aug 01 08:21:45 user nova-compute[72426]:     </nova:instance>
Aug 01 08:21:45 user nova-compute[72426]:   </metadata>
Aug 01 08:21:45 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:21:45 user nova-compute[72426]:     <system>
Aug 01 08:21:45 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:21:45 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:21:45 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:21:45 user nova-compute[72426]:       <entry name="serial">e1119088-18c7-483d-a89d-3b5d19054e52</entry>
Aug 01 08:21:45 user nova-compute[72426]:       <entry name="uuid">e1119088-18c7-483d-a89d-3b5d19054e52</entry>
Aug 01 08:21:45 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:21:45 user nova-compute[72426]:     </system>
Aug 01 08:21:45 user nova-compute[72426]:   </sysinfo>
Aug 01 08:21:45 user nova-compute[72426]:   <os>
Aug 01 08:21:45 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:21:45 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:21:45 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:21:45 user nova-compute[72426]:   </os>
Aug 01 08:21:45 user nova-compute[72426]:   <features>
Aug 01 08:21:45 user nova-compute[72426]:     <acpi/>
Aug 01 08:21:45 user nova-compute[72426]:     <apic/>
Aug 01 08:21:45 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:21:45 user nova-compute[72426]:   </features>
Aug 01 08:21:45 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:21:45 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:21:45 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:21:45 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:21:45 user nova-compute[72426]:   </clock>
Aug 01 08:21:45 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:21:45 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:21:45 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:21:45 user nova-compute[72426]:   </cpu>
Aug 01 08:21:45 user nova-compute[72426]:   <devices>
Aug 01 08:21:45 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:21:45 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:21:45 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk"/>
Aug 01 08:21:45 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:21:45 user nova-compute[72426]:     </disk>
Aug 01 08:21:45 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:21:45 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:21:45 user nova-compute[72426]:       <source dev="/dev/sdc"/>
Aug 01 08:21:45 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:21:45 user nova-compute[72426]:       <serial>de3d896b-64bc-473a-a1d3-090164bd228e</serial>
Aug 01 08:21:45 user nova-compute[72426]:     </disk>
Aug 01 08:21:45 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:21:45 user nova-compute[72426]:       <mac address="fa:16:3e:d4:cf:4b"/>
Aug 01 08:21:45 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:21:45 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:21:45 user nova-compute[72426]:       <target dev="tap9f0b410f-c4"/>
Aug 01 08:21:45 user nova-compute[72426]:     </interface>
Aug 01 08:21:45 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:21:45 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/console.log" append="off"/>
Aug 01 08:21:45 user nova-compute[72426]:     </serial>
Aug 01 08:21:45 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:21:45 user nova-compute[72426]:     <video>
Aug 01 08:21:45 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:21:45 user nova-compute[72426]:     </video>
Aug 01 08:21:45 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:21:45 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:21:45 user nova-compute[72426]:     </rng>
Aug 01 08:21:45 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:21:45 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:21:45 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:21:45 user nova-compute[72426]:     </memballoon>
Aug 01 08:21:45 user nova-compute[72426]:   </devices>
Aug 01 08:21:45 user nova-compute[72426]: </domain>
Aug 01 08:21:45 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'trusted_certs' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Cannot resize image /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'migration_context' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-786606183',display_name='tempest-AttachVolumeTestJSON-server-786606183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-786606183',id=27,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhMcMLFpWRtcugrzk5/raTjStSXB9ipq79Xl+iZRLvhAJzQsUrNTa4A33Y+LFLAJhexCpWGTXgzOp8ywgg15r2gAc8AxCfNY7zz3j9aWRNC0qS56zJkCjoe3hYKglRjfQ==',key_name='tempest-keypair-1553423732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-rcziynoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=e1119088-18c7-483d-a89d-3b5d19054e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG os_vif [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f0b410f-c4, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f0b410f-c4, col_values=(('external_ids', {'iface-id': '9f0b410f-c412-4817-9db3-b9ec5ffe8c09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:cf:4b', 'vm-uuid': 'e1119088-18c7-483d-a89d-3b5d19054e52'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:21:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:45 user nova-compute[72426]: INFO os_vif [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4')
Aug 01 08:21:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-e39ea8fc-79ca-4870-83d7-f9b2e7b8fc68 req-a5b43f83-b45c-43da-9f6e-8f6f58cea927 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e39ea8fc-79ca-4870-83d7-f9b2e7b8fc68 req-a5b43f83-b45c-43da-9f6e-8f6f58cea927 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e39ea8fc-79ca-4870-83d7-f9b2e7b8fc68 req-a5b43f83-b45c-43da-9f6e-8f6f58cea927 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e39ea8fc-79ca-4870-83d7-f9b2e7b8fc68 req-a5b43f83-b45c-43da-9f6e-8f6f58cea927 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-e39ea8fc-79ca-4870-83d7-f9b2e7b8fc68 req-a5b43f83-b45c-43da-9f6e-8f6f58cea927 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:21:47 user nova-compute[72426]: WARNING nova.compute.manager [req-e39ea8fc-79ca-4870-83d7-f9b2e7b8fc68 req-a5b43f83-b45c-43da-9f6e-8f6f58cea927 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state stopped and task_state powering-on.
Aug 01 08:21:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-70e68680-e862-4311-b165-718c06154a16 req-89ebc1cc-5583-4cc9-9897-102d8ef3e68b service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-70e68680-e862-4311-b165-718c06154a16 req-89ebc1cc-5583-4cc9-9897-102d8ef3e68b service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-70e68680-e862-4311-b165-718c06154a16 req-89ebc1cc-5583-4cc9-9897-102d8ef3e68b service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-70e68680-e862-4311-b165-718c06154a16 req-89ebc1cc-5583-4cc9-9897-102d8ef3e68b service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-70e68680-e862-4311-b165-718c06154a16 req-89ebc1cc-5583-4cc9-9897-102d8ef3e68b service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:21:49 user nova-compute[72426]: WARNING nova.compute.manager [req-70e68680-e862-4311-b165-718c06154a16 req-89ebc1cc-5583-4cc9-9897-102d8ef3e68b service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state stopped and task_state powering-on.
Aug 01 08:21:49 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878109.59965, e1119088-18c7-483d-a89d-3b5d19054e52 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:21:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] VM Resumed (Lifecycle Event)
Aug 01 08:21:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:21:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance rebooted successfully.
Aug 01 08:21:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f5b598d2-6df4-49ae-a084-774cd81537ed tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:21:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:21:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:21:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 08:21:49 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878109.6014612, e1119088-18c7-483d-a89d-3b5d19054e52 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:21:49 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] VM Started (Lifecycle Event)
Aug 01 08:21:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:21:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:21:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-e7d93417-974f-41de-bef7-6be32fcc4fa3 req-594865ff-b60a-49b6-b6c7-9b2e8f63e7f1 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-changed-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-e7d93417-974f-41de-bef7-6be32fcc4fa3 req-594865ff-b60a-49b6-b6c7-9b2e8f63e7f1 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Refreshing instance network info cache due to event network-changed-725650f1-c621-47c2-bb87-a85d41c698d3. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:21:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e7d93417-974f-41de-bef7-6be32fcc4fa3 req-594865ff-b60a-49b6-b6c7-9b2e8f63e7f1 service nova] Acquiring lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:21:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e7d93417-974f-41de-bef7-6be32fcc4fa3 req-594865ff-b60a-49b6-b6c7-9b2e8f63e7f1 service nova] Acquired lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:21:53 user nova-compute[72426]: DEBUG nova.network.neutron [req-e7d93417-974f-41de-bef7-6be32fcc4fa3 req-594865ff-b60a-49b6-b6c7-9b2e8f63e7f1 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Refreshing network info cache for port 725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:21:54 user nova-compute[72426]: DEBUG nova.network.neutron [req-e7d93417-974f-41de-bef7-6be32fcc4fa3 req-594865ff-b60a-49b6-b6c7-9b2e8f63e7f1 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updated VIF entry in instance network info cache for port 725650f1-c621-47c2-bb87-a85d41c698d3. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:21:54 user nova-compute[72426]: DEBUG nova.network.neutron [req-e7d93417-974f-41de-bef7-6be32fcc4fa3 req-594865ff-b60a-49b6-b6c7-9b2e8f63e7f1 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updating instance_info_cache with network_info: [{"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:21:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e7d93417-974f-41de-bef7-6be32fcc4fa3 req-594865ff-b60a-49b6-b6c7-9b2e8f63e7f1 service nova] Releasing lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:21:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-170fc52d-386f-4799-a5c9-ebf33a3e2986 req-9980be6d-2fa7-46b5-9cfd-ba1a9823659f service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-changed-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:21:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-170fc52d-386f-4799-a5c9-ebf33a3e2986 req-9980be6d-2fa7-46b5-9cfd-ba1a9823659f service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Refreshing instance network info cache due to event network-changed-725650f1-c621-47c2-bb87-a85d41c698d3. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:21:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-170fc52d-386f-4799-a5c9-ebf33a3e2986 req-9980be6d-2fa7-46b5-9cfd-ba1a9823659f service nova] Acquiring lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:21:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-170fc52d-386f-4799-a5c9-ebf33a3e2986 req-9980be6d-2fa7-46b5-9cfd-ba1a9823659f service nova] Acquired lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:21:54 user nova-compute[72426]: DEBUG nova.network.neutron [req-170fc52d-386f-4799-a5c9-ebf33a3e2986 req-9980be6d-2fa7-46b5-9cfd-ba1a9823659f service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Refreshing network info cache for port 725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:21:55 user nova-compute[72426]: INFO nova.compute.manager [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Detaching volume 37b8e7f7-9793-43d3-8930-7618be0208fc
Aug 01 08:21:55 user nova-compute[72426]: INFO nova.virt.block_device [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Attempting to driver detach volume 37b8e7f7-9793-43d3-8930-7618be0208fc from mountpoint /dev/vdb
Aug 01 08:21:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Attempting to detach device vdb from instance adcf2dea-a758-4e13-9091-fffa6339f670 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:21:55 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:21:55 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:21:55 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:21:55 user nova-compute[72426]:   <serial>37b8e7f7-9793-43d3-8930-7618be0208fc</serial>
Aug 01 08:21:55 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 08:21:55 user nova-compute[72426]: </disk>
Aug 01 08:21:55 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:21:55 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Successfully detached device vdb from instance adcf2dea-a758-4e13-9091-fffa6339f670 from the persistent domain config.
Aug 01 08:21:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adcf2dea-a758-4e13-9091-fffa6339f670 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:21:55 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:21:55 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:21:55 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:21:55 user nova-compute[72426]:   <serial>37b8e7f7-9793-43d3-8930-7618be0208fc</serial>
Aug 01 08:21:55 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 08:21:55 user nova-compute[72426]: </disk>
Aug 01 08:21:55 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG nova.network.neutron [req-170fc52d-386f-4799-a5c9-ebf33a3e2986 req-9980be6d-2fa7-46b5-9cfd-ba1a9823659f service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updated VIF entry in instance network info cache for port 725650f1-c621-47c2-bb87-a85d41c698d3. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG nova.network.neutron [req-170fc52d-386f-4799-a5c9-ebf33a3e2986 req-9980be6d-2fa7-46b5-9cfd-ba1a9823659f service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updating instance_info_cache with network_info: [{"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-170fc52d-386f-4799-a5c9-ebf33a3e2986 req-9980be6d-2fa7-46b5-9cfd-ba1a9823659f service nova] Releasing lock "refresh_cache-adcf2dea-a758-4e13-9091-fffa6339f670" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878115.5758505, adcf2dea-a758-4e13-9091-fffa6339f670 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:21:55 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Successfully detached device vdb from instance adcf2dea-a758-4e13-9091-fffa6339f670 from the live domain config.
Aug 01 08:21:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfoGIwAq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:21:55 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dd3b88-b410-445f-a874-ff5cd0af07cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[397d58bd-b446-4cfe-93b9-7bda4e8a3609]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:21:55 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:21:55 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:21:55 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38e6df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc'): ({'sdf'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Removing single pathed devices sdf {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[59313b4c-86e8-4cb8-b08f-bf7d736f1dbc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[13972c09-6317-4f8a-8199-dbf1169322fd]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Flushing IO for device /dev/sdf {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2399209-74d9-4228-a372-7cf55925c77b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf1b2c7-9be0-4b37-9e60-e9d3844520c5]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d05e64-d019-4bbc-9df5-9bc39af85717]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[356955e5-9c49-403f-9bea-76dde7fe6ae6]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260]
Aug 01 08:21:55 user nova-compute[72426]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc, portal: 172.16.0.220,3260] successful.
Aug 01 08:21:55 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37b8e7f7-9793-43d3-8930-7618be0208fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[76825a73-8189-42a7-b59d-a2a4a4dc6aee]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] <== disconnect_volume: return (320ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:21:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:21:56 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'flavor' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:21:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1fdc801e-774d-4fd8-ab97-07f4da884b12 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.809s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:21:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:00 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:02 user nova-compute[72426]: INFO nova.compute.manager [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Rescuing
Aug 01 08:22:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:22:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquired lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:22:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:22:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Updating instance_info_cache with network_info: [{"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:22:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Releasing lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:22:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-5bfece2c-1259-4fc8-8606-6d6061f57f77 req-a2aeea1d-5744-4801-8c71-c5bf8c60cac5 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-unplugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5bfece2c-1259-4fc8-8606-6d6061f57f77 req-a2aeea1d-5744-4801-8c71-c5bf8c60cac5 service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5bfece2c-1259-4fc8-8606-6d6061f57f77 req-a2aeea1d-5744-4801-8c71-c5bf8c60cac5 service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5bfece2c-1259-4fc8-8606-6d6061f57f77 req-a2aeea1d-5744-4801-8c71-c5bf8c60cac5 service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-5bfece2c-1259-4fc8-8606-6d6061f57f77 req-a2aeea1d-5744-4801-8c71-c5bf8c60cac5 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-unplugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:03 user nova-compute[72426]: WARNING nova.compute.manager [req-5bfece2c-1259-4fc8-8606-6d6061f57f77 req-a2aeea1d-5744-4801-8c71-c5bf8c60cac5 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-unplugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state active and task_state rescuing.
Aug 01 08:22:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Instance destroyed successfully.
Aug 01 08:22:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Attempting a stable device rescue
Aug 01 08:22:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72426) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Instance directory exists: not creating {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 08:22:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Creating image(s)
Aug 01 08:22:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "/opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "/opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'trusted_certs' on Instance uuid b4d8cd69-296b-4253-badc-75e771af39b8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "e636e93a9bebe86938ba1256e8bdb8300638ecd6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "e636e93a9bebe86938ba1256e8bdb8300638ecd6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6.part --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6.part --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.images [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] 9001d76c-1047-4f74-bf02-ff8b9914acd8 was qcow2, converting to raw {{(pid=72426) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6.part /opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6.converted {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-51782f6d-b291-43c2-bfcc-e6ae436dda6d req-2ba3ef70-64cf-49ea-8adc-333bc575529b service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-51782f6d-b291-43c2-bfcc-e6ae436dda6d req-2ba3ef70-64cf-49ea-8adc-333bc575529b service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-51782f6d-b291-43c2-bfcc-e6ae436dda6d req-2ba3ef70-64cf-49ea-8adc-333bc575529b service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-51782f6d-b291-43c2-bfcc-e6ae436dda6d req-2ba3ef70-64cf-49ea-8adc-333bc575529b service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-51782f6d-b291-43c2-bfcc-e6ae436dda6d req-2ba3ef70-64cf-49ea-8adc-333bc575529b service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:05 user nova-compute[72426]: WARNING nova.compute.manager [req-51782f6d-b291-43c2-bfcc-e6ae436dda6d req-2ba3ef70-64cf-49ea-8adc-333bc575529b service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state active and task_state rescuing.
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6.part /opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6.converted" returned: 0 in 0.494s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6.converted --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "e636e93a9bebe86938ba1256e8bdb8300638ecd6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "e636e93a9bebe86938ba1256e8bdb8300638ecd6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "e636e93a9bebe86938ba1256e8bdb8300638ecd6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6 --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6,backing_fmt=raw /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e636e93a9bebe86938ba1256e8bdb8300638ecd6,backing_fmt=raw /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue" returned: 0 in 0.048s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "e636e93a9bebe86938ba1256e8bdb8300638ecd6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'migration_context' on Instance uuid b4d8cd69-296b-4253-badc-75e771af39b8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Start _get_guest_xml network_info=[{"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "vif_mac": "fa:16:3e:0d:ae:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9001d76c-1047-4f74-bf02-ff8b9914acd8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZfTOxPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'b4d8cd69-296b-4253-badc-75e771af39b8', 'attached_at': '', 'detached_at': '', 'volume_id': '04960353-544b-49a8-b57f-567aa153b78a', 'serial': '04960353-544b-49a8-b57f-567aa153b78a'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '828a5553-88f9-47ea-ae93-f5bc12c77826', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'resources' on Instance uuid b4d8cd69-296b-4253-badc-75e771af39b8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'numa_topology' on Instance uuid b4d8cd69-296b-4253-badc-75e771af39b8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:05 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:22:05 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:22:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'vcpu_model' on Instance uuid b4d8cd69-296b-4253-badc-75e771af39b8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZfTOxPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:22:06 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:22:06 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:22:06 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec58bd1e-6286-4b30-aaae-2fb8554421ba]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dZfTOxPc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 08:22:06 user nova-compute[72426]: node.name = iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a
Aug 01 08:22:06 user nova-compute[72426]: node.tpgt = -1
Aug 01 08:22:06 user nova-compute[72426]: node.startup = automatic
Aug 01 08:22:06 user nova-compute[72426]: node.leading_login = No
Aug 01 08:22:06 user nova-compute[72426]: iface.iscsi_ifacename = default
Aug 01 08:22:06 user nova-compute[72426]: iface.net_ifacename = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.ipaddress = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.prefix_len = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.hwaddress = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.transport_name = tcp
Aug 01 08:22:06 user nova-compute[72426]: iface.initiatorname = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.state = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.vlan_id = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.vlan_priority = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.vlan_state = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.iface_num = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.mtu = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.port = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.bootproto = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.subnet_mask = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.gateway = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.dhcp_alt_client_id = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.dhcp_dns = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.dhcp_learn_iqn = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.dhcp_vendor_id_state = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.dhcp_vendor_id = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.dhcp_slp_da = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.fragmentation = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.gratuitous_arp = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.incoming_forwarding = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.tos_state = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.tos = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.ttl = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.delayed_ack = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.tcp_nagle = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.tcp_wsf_state = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.tcp_wsf = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.tcp_timer_scale = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.tcp_timestamp = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.redirect = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.def_task_mgmt_timeout = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.header_digest = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.data_digest = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.immediate_data = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.initial_r2t = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.data_seq_inorder = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.data_pdu_inorder = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.erl = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.max_receive_data_len = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.first_burst_len = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.max_outstanding_r2t = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.max_burst_len = 0
Aug 01 08:22:06 user nova-compute[72426]: iface.chap_auth = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.bidi_chap = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.strict_login_compliance = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.discovery_auth = <empty>
Aug 01 08:22:06 user nova-compute[72426]: iface.discovery_logout = <empty>
Aug 01 08:22:06 user nova-compute[72426]: node.discovery_address = <empty>
Aug 01 08:22:06 user nova-compute[72426]: node.discovery_port = 0
Aug 01 08:22:06 user nova-compute[72426]: node.discovery_type = static
Aug 01 08:22:06 user nova-compute[72426]: node.session.initial_cmdsn = 0
Aug 01 08:22:06 user nova-compute[72426]: node.session.initial_login_retry_max = 8
Aug 01 08:22:06 user nova-compute[72426]: node.session.xmit_thread_priority = -20
Aug 01 08:22:06 user nova-compute[72426]: node.session.cmds_max = 128
Aug 01 08:22:06 user nova-compute[72426]: node.session.queue_depth = 32
Aug 01 08:22:06 user nova-compute[72426]: node.session.nr_sessions = 1
Aug 01 08:22:06 user nova-compute[72426]: node.session.auth.authmethod = CHAP
Aug 01 08:22:06 user nova-compute[72426]: node.session.auth.username = dZfTOxPc
Aug 01 08:22:06 user nova-compute[72426]: node.session.auth.password = ***
Aug 01 08:22:06 user nova-compute[72426]: node.session.auth.username_in = <empty>
Aug 01 08:22:06 user nova-compute[72426]: node.session.auth.password_in = <empty>
Aug 01 08:22:06 user nova-compute[72426]: node.session.auth.chap_algs = MD5
Aug 01 08:22:06 user nova-compute[72426]: node.session.timeo.replacement_timeout = 120
Aug 01 08:22:06 user nova-compute[72426]: node.session.err_timeo.abort_timeout = 15
Aug 01 08:22:06 user nova-compute[72426]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 08:22:06 user nova-compute[72426]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 08:22:06 user nova-compute[72426]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 08:22:06 user nova-compute[72426]: node.session.iscsi.FastAbort = Yes
Aug 01 08:22:06 user nova-compute[72426]: node.session.iscsi.InitialR2T = No
Aug 01 08:22:06 user nova-compute[72426]: node.session.iscsi.ImmediateData = Yes
Aug 01 08:22:06 user nova-compute[72426]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 08:22:06 user nova-compute[72426]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 08:22:06 user nova-compute[72426]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 08:22:06 user nova-compute[72426]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 08:22:06 user nova-compute[72426]: node.session.iscsi.MaxConnections = 1
Aug 01 08:22:06 user nova-compute[72426]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 08:22:06 user nova-compute[72426]: node.session.iscsi.ERL = 0
Aug 01 08:22:06 user nova-compute[72426]: node.session.scan = manual
Aug 01 08:22:06 user nova-compute[72426]: node.session.reopen_max = 0
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].address = 172.16.0.220
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].port = 3260
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].startup = manual
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].tcp.window_size = 524288
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].tcp.type_of_service = 0
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].timeo.logout_timeout = 15
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].timeo.login_timeout = 15
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].timeo.auth_timeout = 45
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].iscsi.DataDigest = None
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].iscsi.IFMarker = No
Aug 01 08:22:06 user nova-compute[72426]: node.conn[0].iscsi.OFMarker = No
Aug 01 08:22:06 user nova-compute[72426]: # END RECORD
Aug 01 08:22:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.101s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e528d810-f338-4c0c-b9dc-2b36be18da21]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.103s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7200f7-c370-4c91-b958-ace9b86ea210]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZfTOxPc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZfTOxPc" returned: 0 in 0.077s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[162ecb53-bfe5-4dd2-8bad-27d22992888d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZfTOxPc'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.064s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5917cfac-37dc-47b9-82d1-44a7f5c5a72e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3749e3-2db3-44c0-955b-ecf1cf1d1d7b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:06 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:06 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:06 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:22:06 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:22:06 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:06 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:06 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:06 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:22:06 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:22:06 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] HCTL ('35', '0', '0', 0) found on session 31 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afba39a-5377-4f53-9915-466f701da555]: (4, ('0 0 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Searching for a device in session 31 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZfTOxPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.441s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] <== connect_volume: return (442ms) {'type': 'block', 'scsi_wwn': '26435323135613531', 'path': '/dev/sdd'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435323135613531', 'path': '/dev/sdd'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1709557568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1709557568',id=31,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-rgo0dk5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:20:37Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=b4d8cd69-296b-4253-badc-75e771af39b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "vif_mac": "fa:16:3e:0d:ae:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "vif_mac": "fa:16:3e:0d:ae:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=f57a2eab-0805-47c8-a545-d2e08590b2d1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57a2eab-08') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'pci_devices' on Instance uuid b4d8cd69-296b-4253-badc-75e771af39b8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:22:06 user nova-compute[72426]:   <uuid>b4d8cd69-296b-4253-badc-75e771af39b8</uuid>
Aug 01 08:22:06 user nova-compute[72426]:   <name>instance-0000001f</name>
Aug 01 08:22:06 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:22:06 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:22:06 user nova-compute[72426]:   <metadata>
Aug 01 08:22:06 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:22:06 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:22:06 user nova-compute[72426]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1709557568</nova:name>
Aug 01 08:22:06 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:22:05</nova:creationTime>
Aug 01 08:22:06 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:22:06 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:22:06 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:22:06 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:22:06 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:22:06 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:22:06 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:22:06 user nova-compute[72426]:       <nova:owner>
Aug 01 08:22:06 user nova-compute[72426]:         <nova:user uuid="184d71425948492e835ea8f0dd857d1f">tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member</nova:user>
Aug 01 08:22:06 user nova-compute[72426]:         <nova:project uuid="d0b6971ed0a343468f071e1e25c27d5b">tempest-ServerBootFromVolumeStableRescueTest-2030640431</nova:project>
Aug 01 08:22:06 user nova-compute[72426]:       </nova:owner>
Aug 01 08:22:06 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:22:06 user nova-compute[72426]:       <nova:ports>
Aug 01 08:22:06 user nova-compute[72426]:         <nova:port uuid="f57a2eab-0805-47c8-a545-d2e08590b2d1">
Aug 01 08:22:06 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 08:22:06 user nova-compute[72426]:         </nova:port>
Aug 01 08:22:06 user nova-compute[72426]:       </nova:ports>
Aug 01 08:22:06 user nova-compute[72426]:     </nova:instance>
Aug 01 08:22:06 user nova-compute[72426]:   </metadata>
Aug 01 08:22:06 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:22:06 user nova-compute[72426]:     <system>
Aug 01 08:22:06 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:22:06 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:22:06 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:22:06 user nova-compute[72426]:       <entry name="serial">b4d8cd69-296b-4253-badc-75e771af39b8</entry>
Aug 01 08:22:06 user nova-compute[72426]:       <entry name="uuid">b4d8cd69-296b-4253-badc-75e771af39b8</entry>
Aug 01 08:22:06 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:22:06 user nova-compute[72426]:     </system>
Aug 01 08:22:06 user nova-compute[72426]:   </sysinfo>
Aug 01 08:22:06 user nova-compute[72426]:   <os>
Aug 01 08:22:06 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:22:06 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:22:06 user nova-compute[72426]:   </os>
Aug 01 08:22:06 user nova-compute[72426]:   <features>
Aug 01 08:22:06 user nova-compute[72426]:     <acpi/>
Aug 01 08:22:06 user nova-compute[72426]:     <apic/>
Aug 01 08:22:06 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:22:06 user nova-compute[72426]:   </features>
Aug 01 08:22:06 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:22:06 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:22:06 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:22:06 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:22:06 user nova-compute[72426]:   </clock>
Aug 01 08:22:06 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:22:06 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:22:06 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:22:06 user nova-compute[72426]:   </cpu>
Aug 01 08:22:06 user nova-compute[72426]:   <devices>
Aug 01 08:22:06 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:22:06 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:22:06 user nova-compute[72426]:       <source dev="/dev/sdd"/>
Aug 01 08:22:06 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:22:06 user nova-compute[72426]:       <serial>04960353-544b-49a8-b57f-567aa153b78a</serial>
Aug 01 08:22:06 user nova-compute[72426]:     </disk>
Aug 01 08:22:06 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:22:06 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:22:06 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue"/>
Aug 01 08:22:06 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:22:06 user nova-compute[72426]:       <boot order="1"/>
Aug 01 08:22:06 user nova-compute[72426]:     </disk>
Aug 01 08:22:06 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:22:06 user nova-compute[72426]:       <mac address="fa:16:3e:0d:ae:14"/>
Aug 01 08:22:06 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:22:06 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:22:06 user nova-compute[72426]:       <target dev="tapf57a2eab-08"/>
Aug 01 08:22:06 user nova-compute[72426]:     </interface>
Aug 01 08:22:06 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:22:06 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/console.log" append="off"/>
Aug 01 08:22:06 user nova-compute[72426]:     </serial>
Aug 01 08:22:06 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:22:06 user nova-compute[72426]:     <video>
Aug 01 08:22:06 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:22:06 user nova-compute[72426]:     </video>
Aug 01 08:22:06 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:22:06 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:22:06 user nova-compute[72426]:     </rng>
Aug 01 08:22:06 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:22:06 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:22:06 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:22:06 user nova-compute[72426]:     </memballoon>
Aug 01 08:22:06 user nova-compute[72426]:   </devices>
Aug 01 08:22:06 user nova-compute[72426]: </domain>
Aug 01 08:22:06 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:22:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Instance destroyed successfully.
Aug 01 08:22:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:22:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] No VIF found with MAC fa:16:3e:0d:ae:14, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:22:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-736b5abe-3f13-44da-808f-3b5f0f02490d req-032959e9-bbb8-4c7f-b844-1cf30075efbd service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-736b5abe-3f13-44da-808f-3b5f0f02490d req-032959e9-bbb8-4c7f-b844-1cf30075efbd service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-736b5abe-3f13-44da-808f-3b5f0f02490d req-032959e9-bbb8-4c7f-b844-1cf30075efbd service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-736b5abe-3f13-44da-808f-3b5f0f02490d req-032959e9-bbb8-4c7f-b844-1cf30075efbd service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-736b5abe-3f13-44da-808f-3b5f0f02490d req-032959e9-bbb8-4c7f-b844-1cf30075efbd service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:08 user nova-compute[72426]: WARNING nova.compute.manager [req-736b5abe-3f13-44da-808f-3b5f0f02490d req-032959e9-bbb8-4c7f-b844-1cf30075efbd service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state active and task_state rescuing.
Aug 01 08:22:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "dddef04a-9dbe-4b36-bdf0-55d20816b607" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "dddef04a-9dbe-4b36-bdf0-55d20816b607" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:22:08 user nova-compute[72426]: INFO nova.compute.claims [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Claim successful on node user
Aug 01 08:22:09 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG nova.network.neutron [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:22:09 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:22:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:22:09 user nova-compute[72426]: INFO nova.virt.block_device [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Booting with volume 28656c75-f762-4c35-b55a-7f9878b6d83b at /dev/vda
Aug 01 08:22:09 user nova-compute[72426]: DEBUG nova.policy [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49f9ffcf2a8a435a968fd41590d90607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f71856fa7cb47b998a77b3f4ba436d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG os_brick.utils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9bc3d7-34e3-4298-ac35-f094f031ee3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28fe26f-3a36-46ca-88ec-39e2860a2846]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa29c5e-0dc5-4459-b482-7f488f442545]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0326d26-fa82-4a85-94fc-4d59724d19dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:22:09 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:22:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec0a89f-ceb3-4901-a256-bcedc0bcbf25]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG os_brick.utils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:22:09 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Updating existing volume attachment record: 56a569ae-dfc4-4673-9777-f8618b192023 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for b4d8cd69-296b-4253-badc-75e771af39b8 due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878130.2938473, b4d8cd69-296b-4253-badc-75e771af39b8 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:22:10 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] VM Resumed (Lifecycle Event)
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.compute.manager [None req-cb6e1b7a-180b-4330-8fb4-752b5bfbaba6 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:22:10 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878130.3009467, b4d8cd69-296b-4253-badc-75e771af39b8 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:22:10 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] VM Started (Lifecycle Event)
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-c0fba1e6-645a-424a-a309-6a00c9fb4a6b req-796d96f9-6f04-4340-b654-888e2e629c0a service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c0fba1e6-645a-424a-a309-6a00c9fb4a6b req-796d96f9-6f04-4340-b654-888e2e629c0a service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c0fba1e6-645a-424a-a309-6a00c9fb4a6b req-796d96f9-6f04-4340-b654-888e2e629c0a service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c0fba1e6-645a-424a-a309-6a00c9fb4a6b req-796d96f9-6f04-4340-b654-888e2e629c0a service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-c0fba1e6-645a-424a-a309-6a00c9fb4a6b req-796d96f9-6f04-4340-b654-888e2e629c0a service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:10 user nova-compute[72426]: WARNING nova.compute.manager [req-c0fba1e6-645a-424a-a309-6a00c9fb4a6b req-796d96f9-6f04-4340-b654-888e2e629c0a service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state rescued and task_state None.
Aug 01 08:22:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG nova.network.neutron [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Successfully created port: 6cbbe631-3230-4992-9366-5e8e9c3951b3 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:22:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG nova.network.neutron [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Successfully updated port: 6cbbe631-3230-4992-9366-5e8e9c3951b3 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "refresh_cache-dddef04a-9dbe-4b36-bdf0-55d20816b607" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquired lock "refresh_cache-dddef04a-9dbe-4b36-bdf0-55d20816b607" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG nova.network.neutron [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-a42d74e4-6101-42d8-b7a6-9511c15c7b8e req-5e2ca3cc-7385-4cec-9afd-502db84b3694 service nova] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Received event network-changed-6cbbe631-3230-4992-9366-5e8e9c3951b3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-a42d74e4-6101-42d8-b7a6-9511c15c7b8e req-5e2ca3cc-7385-4cec-9afd-502db84b3694 service nova] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Refreshing instance network info cache due to event network-changed-6cbbe631-3230-4992-9366-5e8e9c3951b3. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a42d74e4-6101-42d8-b7a6-9511c15c7b8e req-5e2ca3cc-7385-4cec-9afd-502db84b3694 service nova] Acquiring lock "refresh_cache-dddef04a-9dbe-4b36-bdf0-55d20816b607" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG nova.network.neutron [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG nova.network.neutron [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Updating instance_info_cache with network_info: [{"id": "6cbbe631-3230-4992-9366-5e8e9c3951b3", "address": "fa:16:3e:1b:6f:2e", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbbe631-32", "ovs_interfaceid": "6cbbe631-3230-4992-9366-5e8e9c3951b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Releasing lock "refresh_cache-dddef04a-9dbe-4b36-bdf0-55d20816b607" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Instance network_info: |[{"id": "6cbbe631-3230-4992-9366-5e8e9c3951b3", "address": "fa:16:3e:1b:6f:2e", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbbe631-32", "ovs_interfaceid": "6cbbe631-3230-4992-9366-5e8e9c3951b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a42d74e4-6101-42d8-b7a6-9511c15c7b8e req-5e2ca3cc-7385-4cec-9afd-502db84b3694 service nova] Acquired lock "refresh_cache-dddef04a-9dbe-4b36-bdf0-55d20816b607" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:22:11 user nova-compute[72426]: DEBUG nova.network.neutron [req-a42d74e4-6101-42d8-b7a6-9511c15c7b8e req-5e2ca3cc-7385-4cec-9afd-502db84b3694 service nova] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Refreshing network info cache for port 6cbbe631-3230-4992-9366-5e8e9c3951b3 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:22:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:12 user nova-compute[72426]: DEBUG nova.network.neutron [req-a42d74e4-6101-42d8-b7a6-9511c15c7b8e req-5e2ca3cc-7385-4cec-9afd-502db84b3694 service nova] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Updated VIF entry in instance network info cache for port 6cbbe631-3230-4992-9366-5e8e9c3951b3. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:22:12 user nova-compute[72426]: DEBUG nova.network.neutron [req-a42d74e4-6101-42d8-b7a6-9511c15c7b8e req-5e2ca3cc-7385-4cec-9afd-502db84b3694 service nova] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Updating instance_info_cache with network_info: [{"id": "6cbbe631-3230-4992-9366-5e8e9c3951b3", "address": "fa:16:3e:1b:6f:2e", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbbe631-32", "ovs_interfaceid": "6cbbe631-3230-4992-9366-5e8e9c3951b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:22:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a42d74e4-6101-42d8-b7a6-9511c15c7b8e req-5e2ca3cc-7385-4cec-9afd-502db84b3694 service nova] Releasing lock "refresh_cache-dddef04a-9dbe-4b36-bdf0-55d20816b607" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:22:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:13 user nova-compute[72426]: INFO nova.compute.manager [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Terminating instance
Aug 01 08:22:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:22:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-d6ba2ce6-060b-4bff-b229-3185498b89df req-9d657b2c-8d3a-4769-84c6-c0df07d26aa5 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-vif-unplugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d6ba2ce6-060b-4bff-b229-3185498b89df req-9d657b2c-8d3a-4769-84c6-c0df07d26aa5 service nova] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d6ba2ce6-060b-4bff-b229-3185498b89df req-9d657b2c-8d3a-4769-84c6-c0df07d26aa5 service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d6ba2ce6-060b-4bff-b229-3185498b89df req-9d657b2c-8d3a-4769-84c6-c0df07d26aa5 service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-d6ba2ce6-060b-4bff-b229-3185498b89df req-9d657b2c-8d3a-4769-84c6-c0df07d26aa5 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] No waiting events found dispatching network-vif-unplugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-d6ba2ce6-060b-4bff-b229-3185498b89df req-9d657b2c-8d3a-4769-84c6-c0df07d26aa5 service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-vif-unplugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Instance destroyed successfully.
Aug 01 08:22:14 user nova-compute[72426]: DEBUG nova.objects.instance [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'resources' on Instance uuid 711f36c5-6692-4aec-b4fe-0aac97dfef12 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-440152097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-386058360',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUuL6cIXOsVrN6GIqUyK3HSUIpRTiR6zIQsvQNqNDHMMOEkoFYsfvVw69PiuMAGsuyCOnnclpwgQI01DdYX76WXL3mjwTVlxrwB/mCjKb1sBbHecoDrcN2Zz6sELtcULg==',key_name='tempest-keypair-2041214637',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:20:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7be045e22d244d6984b171cd0345b6ec',ramdisk_id='',reservation_id='r-y0xq8j4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-328470853',owner_user_name='tempest-ServerActionsV293TestJSON-328470853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3b164242dc4336889758526ddabd74',uuid=711f36c5-6692-4aec-b4fe-0aac97dfef12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converting VIF {"id": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "address": "fa:16:3e:e7:2b:c2", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77776de-ab", "ovs_interfaceid": "e77776de-abb0-4125-bb7d-69f76d60d9f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_vif [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape77776de-ab, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:22:14 user nova-compute[72426]: INFO os_vif [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:2b:c2,bridge_name='br-int',has_traffic_filtering=True,id=e77776de-abb0-4125-bb7d-69f76d60d9f6,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77776de-ab')
Aug 01 08:22:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjYNpHBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:22:14 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5c6f26-bc23-4736-85e4-7d1c8edbb00a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5a0525-4876-4de3-87ec-2cce54ebc1df]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:14 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:14 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:14 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:22:14 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:22:14 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:14 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:14 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:14 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:14 user nova-compute[72426]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 (non-flash)
Aug 01 08:22:14 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:22:14 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:14 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c8ba1d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21'): ({'sdh'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Removing single pathed devices sdh {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d974458-9758-452d-b51b-8c7b95bf57ab]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b84f37-0320-457c-8f8e-aa4b6ea51eb7]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Flushing IO for device /dev/sdh {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c525e8cb-8feb-49be-9341-112ede25a51c]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a25a314-8466-44c8-9879-bf8d15b84cb7]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] SCSI volumes sdh have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3e0d', '/dev/disk/by-id/scsi-1SCST_BIO3e0d-35cdfc9ff631ad27', '/dev/disk/by-id/scsi-23335636466633966') {{(pid=83442) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e79ba34-3293-43ad-a55f-d72183493bcb]: (4, None) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a06ebf-d843-4805-8fb2-f989953e4563]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6184a6f3-e655-4535-b4d5-ab961c3e720e]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260]
Aug 01 08:22:14 user nova-compute[72426]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21, portal: 172.16.0.220,3260] successful.
Aug 01 08:22:14 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44f3647-8846-441c-a9f5-34de4e21d9f3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] <== disconnect_volume: return (321ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:22:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:22:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Deleting instance files /opt/stack/data/nova/instances/711f36c5-6692-4aec-b4fe-0aac97dfef12_del
Aug 01 08:22:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Deletion of /opt/stack/data/nova/instances/711f36c5-6692-4aec-b4fe-0aac97dfef12_del complete
Aug 01 08:22:15 user nova-compute[72426]: INFO nova.compute.manager [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 01 08:22:15 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:22:15 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:22:15 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:22:16 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:22:16 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Took 1.10 seconds to deallocate network for instance.
Aug 01 08:22:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-1a742be0-a880-4b48-ac11-219f35bed5b4 req-bddb0b48-fe80-4023-bc8e-d963621a509d service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1a742be0-a880-4b48-ac11-219f35bed5b4 req-bddb0b48-fe80-4023-bc8e-d963621a509d service nova] Acquiring lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1a742be0-a880-4b48-ac11-219f35bed5b4 req-bddb0b48-fe80-4023-bc8e-d963621a509d service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1a742be0-a880-4b48-ac11-219f35bed5b4 req-bddb0b48-fe80-4023-bc8e-d963621a509d service nova] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-1a742be0-a880-4b48-ac11-219f35bed5b4 req-bddb0b48-fe80-4023-bc8e-d963621a509d service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] No waiting events found dispatching network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:16 user nova-compute[72426]: WARNING nova.compute.manager [req-1a742be0-a880-4b48-ac11-219f35bed5b4 req-bddb0b48-fe80-4023-bc8e-d963621a509d service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received unexpected event network-vif-plugged-e77776de-abb0-4125-bb7d-69f76d60d9f6 for instance with vm_state active and task_state deleting.
Aug 01 08:22:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-1a742be0-a880-4b48-ac11-219f35bed5b4 req-bddb0b48-fe80-4023-bc8e-d963621a509d service nova] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Received event network-vif-deleted-e77776de-abb0-4125-bb7d-69f76d60d9f6 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:16 user nova-compute[72426]: INFO nova.compute.manager [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Took 0.87 seconds to detach 1 volumes for instance.
Aug 01 08:22:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Deleting volume: b265c54d-477a-4089-a4e6-78d137658f21 {{(pid=72426) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 08:22:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.volume.cinder [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Update attachment failed for attachment 56a569ae-dfc4-4673-9777-f8618b192023. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 was not found.).). (HTTP 500) (Request-ID: req-51c6c0bf-04a6-421d-8b4b-3221ddd84321) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 was not found.).). (HTTP 500) (Request-ID: req-51c6c0bf-04a6-421d-8b4b-3221ddd84321)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 was not found.).). (HTTP 500) (Request-ID: req-51c6c0bf-04a6-421d-8b4b-3221ddd84321)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Traceback (most recent call last):
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     driver_block_device.attach_block_devices(
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     _log_and_attach(device)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     bdm.attach(*attach_args, **attach_kwargs)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     ret_val = method(obj, context, *args, **kwargs)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     self._do_attach(context, instance, volume, volume_api,
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     self._volume_attach(context, volume, connector, instance,
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     connection_info = volume_api.attachment_update(
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     res = method(self, ctx, *args, **kwargs)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     with excutils.save_and_reraise_exception():
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     self.force_reraise()
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     raise self.value
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     context, '3.44', skip_version_check=True).attachments.update(
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     return method.func(obj, *args, **kwargs)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     resp = self._update('/attachments/%s' % id, body)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     return self._cs_request(url, 'PUT', **kwargs)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     return self.request(url, method, **kwargs)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607]     raise exceptions.from_response(resp, body)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 was not found.).). (HTTP 500) (Request-ID: req-51c6c0bf-04a6-421d-8b4b-3221ddd84321)
Aug 01 08:22:17 user nova-compute[72426]: ERROR nova.compute.manager [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] 
Aug 01 08:22:17 user nova-compute[72426]: DEBUG nova.compute.claims [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Aborting claim: <nova.compute.claims.Claim object at 0x7f8c38e0eb60> {{(pid=72426) abort /opt/stack/nova/nova/compute/claims.py:84}}
Aug 01 08:22:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:17 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:22:17 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:22:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.293s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:17 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Deleted allocations for instance 711f36c5-6692-4aec-b4fe-0aac97dfef12
Aug 01 08:22:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-aab2f830-b683-44fd-b4cc-0dfe38203b2c tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "711f36c5-6692-4aec-b4fe-0aac97dfef12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.016s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.575s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Build of instance dddef04a-9dbe-4b36-bdf0-55d20816b607 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 was not found.).). (HTTP 500) (Request-ID: req-51c6c0bf-04a6-421d-8b4b-3221ddd84321) {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2644}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.compute.utils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Build of instance dddef04a-9dbe-4b36-bdf0-55d20816b607 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:28656 {{(pid=72426) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Aug 01 08:22:18 user nova-compute[72426]: ERROR nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Build of instance dddef04a-9dbe-4b36-bdf0-55d20816b607 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 was not found.).). (HTTP 500) (Request-ID: req-51c6c0bf-04a6-421d-8b4b-3221ddd84321): nova.exception.BuildAbortException: Build of instance dddef04a-9dbe-4b36-bdf0-55d20816b607 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:28656c75-f762-4c35-b55a-7f9878b6d83b/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:b265c54d-477a-4089-a4e6-78d137658f21 was not found.).). (HTTP 500) (Request-ID: req-51c6c0bf-04a6-421d-8b4b-3221ddd84321)
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Unplugging VIFs for instance {{(pid=72426) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2980}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1660159153',display_name='tempest-TestVolumeBootPattern-server-1660159153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1660159153',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwAhreXMhTB8T7LTS3WDX6kRgXb9BnVYEZYQPoF5FGH3bUHuQnuMUueZ+xzRUaxNgyiXc9pf2QAsQhWnhK9+E2tjM6RN1qVUihVAZ+qSqWDvdICQ1ao5vxLw9JyWyV35g==',key_name='tempest-TestVolumeBootPattern-315952015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f71856fa7cb47b998a77b3f4ba436d7',ramdisk_id='',reservation_id='r-cgiiakyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-942085866',owner_user_name='tempest-TestVolumeBootPattern-942085866-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:22:09Z,user_data=None,user_id='49f9ffcf2a8a435a968fd41590d90607',uuid=dddef04a-9dbe-4b36-bdf0-55d20816b607,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cbbe631-3230-4992-9366-5e8e9c3951b3", "address": "fa:16:3e:1b:6f:2e", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbbe631-32", "ovs_interfaceid": "6cbbe631-3230-4992-9366-5e8e9c3951b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converting VIF {"id": "6cbbe631-3230-4992-9366-5e8e9c3951b3", "address": "fa:16:3e:1b:6f:2e", "network": {"id": "c46a7f43-01ae-4c3c-94b9-1590729ce321", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1154790961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f71856fa7cb47b998a77b3f4ba436d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbbe631-32", "ovs_interfaceid": "6cbbe631-3230-4992-9366-5e8e9c3951b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:6f:2e,bridge_name='br-int',has_traffic_filtering=True,id=6cbbe631-3230-4992-9366-5e8e9c3951b3,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbbe631-32') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG os_vif [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:6f:2e,bridge_name='br-int',has_traffic_filtering=True,id=6cbbe631-3230-4992-9366-5e8e9c3951b3,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbbe631-32') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cbbe631-32, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:22:18 user nova-compute[72426]: INFO os_vif [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:6f:2e,bridge_name='br-int',has_traffic_filtering=True,id=6cbbe631-3230-4992-9366-5e8e9c3951b3,network=Network(c46a7f43-01ae-4c3c-94b9-1590729ce321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbbe631-32')
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Unplugged VIFs for instance {{(pid=72426) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3016}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.network.neutron [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:22:18 user nova-compute[72426]: INFO nova.compute.claims [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Claim successful on node user
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.network.neutron [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:22:18 user nova-compute[72426]: INFO nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Took 0.64 seconds to deallocate network for instance.
Aug 01 08:22:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Detaching volume: 28656c75-f762-4c35-b55a-7f9878b6d83b {{(pid=72426) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3208}}
Aug 01 08:22:18 user nova-compute[72426]: INFO nova.compute.manager [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Detaching volume 28656c75-f762-4c35-b55a-7f9878b6d83b
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] [instance: dddef04a-9dbe-4b36-bdf0-55d20816b607] Skipping driver_detach during remote rebuild. {{(pid=72426) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:22:19 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Deleted allocations for instance dddef04a-9dbe-4b36-bdf0-55d20816b607
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-321516fc-37f9-4bb5-87aa-6387ed68deee tempest-TestVolumeBootPattern-942085866 tempest-TestVolumeBootPattern-942085866-project-member] Lock "dddef04a-9dbe-4b36-bdf0-55d20816b607" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.545s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.network.neutron [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:22:19 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.policy [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e024ff90ae7148819d1d518d3754733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba9024541f804b259eeed3f2dd0ce12f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:22:19 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Creating image(s)
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk 1073741824" returned: 0 in 0.051s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:19 user nova-compute[72426]: DEBUG nova.network.neutron [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Successfully created port: 068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Cannot resize image /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG nova.objects.instance [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'migration_context' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Ensure instance console log exists: /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG nova.network.neutron [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Successfully updated port: 068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquired lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG nova.network.neutron [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG nova.network.neutron [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-376cc83c-da9a-42e6-94ca-ec499a84f59b req-6102b100-c984-46dc-aee4-1f0914e76af1 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-changed-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-376cc83c-da9a-42e6-94ca-ec499a84f59b req-6102b100-c984-46dc-aee4-1f0914e76af1 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Refreshing instance network info cache due to event network-changed-068c4e66-773c-4192-ab91-664b48a5fe9e. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:22:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-376cc83c-da9a-42e6-94ca-ec499a84f59b req-6102b100-c984-46dc-aee4-1f0914e76af1 service nova] Acquiring lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating instance_info_cache with network_info: [{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Releasing lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Instance network_info: |[{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-376cc83c-da9a-42e6-94ca-ec499a84f59b req-6102b100-c984-46dc-aee4-1f0914e76af1 service nova] Acquired lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-376cc83c-da9a-42e6-94ca-ec499a84f59b req-6102b100-c984-46dc-aee4-1f0914e76af1 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Refreshing network info cache for port 068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Start _get_guest_xml network_info=[{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:22:21 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:22:21 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:22:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2113830838',display_name='tempest-ServerRescueNegativeTestJSON-server-2113830838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2113830838',id=34,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmtOi+bpc4SNJclltShPtVhZ2QLhLTJtvjPq0Y7w1K2KmdAkgHdbi/NZD+sFFRgCAHd0Mv5FbBE1+JKB4eeZ2wTuddjE5J4Z7huLigft3Un4MM8fMXHMUxilPaF6xAlCg==',key_name='tempest-keypair-1565746410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-dsegwca3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:22:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e024ff90ae7148819d1d518d3754733f',uuid=c707f931-d77d-44c8-a352-49e673ff6c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cd:30,bridge_name='br-int',has_traffic_filtering=True,id=068c4e66-773c-4192-ab91-664b48a5fe9e,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c4e66-77') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.objects.instance [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'pci_devices' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:22:21 user nova-compute[72426]:   <uuid>c707f931-d77d-44c8-a352-49e673ff6c0b</uuid>
Aug 01 08:22:21 user nova-compute[72426]:   <name>instance-00000022</name>
Aug 01 08:22:21 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:22:21 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:22:21 user nova-compute[72426]:   <metadata>
Aug 01 08:22:21 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:22:21 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:22:21 user nova-compute[72426]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2113830838</nova:name>
Aug 01 08:22:21 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:22:21</nova:creationTime>
Aug 01 08:22:21 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:22:21 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:22:21 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:22:21 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:22:21 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:22:21 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:22:21 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:22:21 user nova-compute[72426]:       <nova:owner>
Aug 01 08:22:21 user nova-compute[72426]:         <nova:user uuid="e024ff90ae7148819d1d518d3754733f">tempest-ServerRescueNegativeTestJSON-1267015268-project-member</nova:user>
Aug 01 08:22:21 user nova-compute[72426]:         <nova:project uuid="ba9024541f804b259eeed3f2dd0ce12f">tempest-ServerRescueNegativeTestJSON-1267015268</nova:project>
Aug 01 08:22:21 user nova-compute[72426]:       </nova:owner>
Aug 01 08:22:21 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:22:21 user nova-compute[72426]:       <nova:ports>
Aug 01 08:22:21 user nova-compute[72426]:         <nova:port uuid="068c4e66-773c-4192-ab91-664b48a5fe9e">
Aug 01 08:22:21 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 08:22:21 user nova-compute[72426]:         </nova:port>
Aug 01 08:22:21 user nova-compute[72426]:       </nova:ports>
Aug 01 08:22:21 user nova-compute[72426]:     </nova:instance>
Aug 01 08:22:21 user nova-compute[72426]:   </metadata>
Aug 01 08:22:21 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:22:21 user nova-compute[72426]:     <system>
Aug 01 08:22:21 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:22:21 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:22:21 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:22:21 user nova-compute[72426]:       <entry name="serial">c707f931-d77d-44c8-a352-49e673ff6c0b</entry>
Aug 01 08:22:21 user nova-compute[72426]:       <entry name="uuid">c707f931-d77d-44c8-a352-49e673ff6c0b</entry>
Aug 01 08:22:21 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:22:21 user nova-compute[72426]:     </system>
Aug 01 08:22:21 user nova-compute[72426]:   </sysinfo>
Aug 01 08:22:21 user nova-compute[72426]:   <os>
Aug 01 08:22:21 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:22:21 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:22:21 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:22:21 user nova-compute[72426]:   </os>
Aug 01 08:22:21 user nova-compute[72426]:   <features>
Aug 01 08:22:21 user nova-compute[72426]:     <acpi/>
Aug 01 08:22:21 user nova-compute[72426]:     <apic/>
Aug 01 08:22:21 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:22:21 user nova-compute[72426]:   </features>
Aug 01 08:22:21 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:22:21 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:22:21 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:22:21 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:22:21 user nova-compute[72426]:   </clock>
Aug 01 08:22:21 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:22:21 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:22:21 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:22:21 user nova-compute[72426]:   </cpu>
Aug 01 08:22:21 user nova-compute[72426]:   <devices>
Aug 01 08:22:21 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:22:21 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:22:21 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk"/>
Aug 01 08:22:21 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:22:21 user nova-compute[72426]:     </disk>
Aug 01 08:22:21 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:22:21 user nova-compute[72426]:       <mac address="fa:16:3e:e4:cd:30"/>
Aug 01 08:22:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:22:21 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:22:21 user nova-compute[72426]:       <target dev="tap068c4e66-77"/>
Aug 01 08:22:21 user nova-compute[72426]:     </interface>
Aug 01 08:22:21 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:22:21 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/console.log" append="off"/>
Aug 01 08:22:21 user nova-compute[72426]:     </serial>
Aug 01 08:22:21 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:22:21 user nova-compute[72426]:     <video>
Aug 01 08:22:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:22:21 user nova-compute[72426]:     </video>
Aug 01 08:22:21 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:22:21 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:22:21 user nova-compute[72426]:     </rng>
Aug 01 08:22:21 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:22:21 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:22:21 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:22:21 user nova-compute[72426]:     </memballoon>
Aug 01 08:22:21 user nova-compute[72426]:   </devices>
Aug 01 08:22:21 user nova-compute[72426]: </domain>
Aug 01 08:22:21 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:22:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2113830838',display_name='tempest-ServerRescueNegativeTestJSON-server-2113830838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2113830838',id=34,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmtOi+bpc4SNJclltShPtVhZ2QLhLTJtvjPq0Y7w1K2KmdAkgHdbi/NZD+sFFRgCAHd0Mv5FbBE1+JKB4eeZ2wTuddjE5J4Z7huLigft3Un4MM8fMXHMUxilPaF6xAlCg==',key_name='tempest-keypair-1565746410',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-dsegwca3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:22:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e024ff90ae7148819d1d518d3754733f',uuid=c707f931-d77d-44c8-a352-49e673ff6c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cd:30,bridge_name='br-int',has_traffic_filtering=True,id=068c4e66-773c-4192-ab91-664b48a5fe9e,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c4e66-77') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG os_vif [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cd:30,bridge_name='br-int',has_traffic_filtering=True,id=068c4e66-773c-4192-ab91-664b48a5fe9e,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c4e66-77') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap068c4e66-77, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap068c4e66-77, col_values=(('external_ids', {'iface-id': '068c4e66-773c-4192-ab91-664b48a5fe9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:cd:30', 'vm-uuid': 'c707f931-d77d-44c8-a352-49e673ff6c0b'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:21 user nova-compute[72426]: INFO os_vif [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cd:30,bridge_name='br-int',has_traffic_filtering=True,id=068c4e66-773c-4192-ab91-664b48a5fe9e,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c4e66-77')
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No VIF found with MAC fa:16:3e:e4:cd:30, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-376cc83c-da9a-42e6-94ca-ec499a84f59b req-6102b100-c984-46dc-aee4-1f0914e76af1 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updated VIF entry in instance network info cache for port 068c4e66-773c-4192-ab91-664b48a5fe9e. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-376cc83c-da9a-42e6-94ca-ec499a84f59b req-6102b100-c984-46dc-aee4-1f0914e76af1 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating instance_info_cache with network_info: [{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:22:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-376cc83c-da9a-42e6-94ca-ec499a84f59b req-6102b100-c984-46dc-aee4-1f0914e76af1 service nova] Releasing lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:22:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-4c1a5897-89a5-4d78-9bce-0bfd70edecde req-a3b318ea-1bfa-498a-bbcf-2df41f3efce2 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4c1a5897-89a5-4d78-9bce-0bfd70edecde req-a3b318ea-1bfa-498a-bbcf-2df41f3efce2 service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4c1a5897-89a5-4d78-9bce-0bfd70edecde req-a3b318ea-1bfa-498a-bbcf-2df41f3efce2 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4c1a5897-89a5-4d78-9bce-0bfd70edecde req-a3b318ea-1bfa-498a-bbcf-2df41f3efce2 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-4c1a5897-89a5-4d78-9bce-0bfd70edecde req-a3b318ea-1bfa-498a-bbcf-2df41f3efce2 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:23 user nova-compute[72426]: WARNING nova.compute.manager [req-4c1a5897-89a5-4d78-9bce-0bfd70edecde req-a3b318ea-1bfa-498a-bbcf-2df41f3efce2 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state building and task_state spawning.
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878144.9144595, c707f931-d77d-44c8-a352-49e673ff6c0b => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:22:24 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] VM Resumed (Lifecycle Event)
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.compute.manager [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:22:24 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Instance spawned successfully.
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:22:24 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878144.9178965, c707f931-d77d-44c8-a352-49e673ff6c0b => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:22:24 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] VM Started (Lifecycle Event)
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:22:24 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:22:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:22:25 user nova-compute[72426]: INFO nova.compute.manager [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 01 08:22:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:22:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-4a49fe07-aa77-4205-a162-1a54f224fbf0 req-f3ed8ead-12fe-4916-b5ef-4f535500fdf9 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4a49fe07-aa77-4205-a162-1a54f224fbf0 req-f3ed8ead-12fe-4916-b5ef-4f535500fdf9 service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4a49fe07-aa77-4205-a162-1a54f224fbf0 req-f3ed8ead-12fe-4916-b5ef-4f535500fdf9 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4a49fe07-aa77-4205-a162-1a54f224fbf0 req-f3ed8ead-12fe-4916-b5ef-4f535500fdf9 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-4a49fe07-aa77-4205-a162-1a54f224fbf0 req-f3ed8ead-12fe-4916-b5ef-4f535500fdf9 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:25 user nova-compute[72426]: WARNING nova.compute.manager [req-4a49fe07-aa77-4205-a162-1a54f224fbf0 req-f3ed8ead-12fe-4916-b5ef-4f535500fdf9 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state building and task_state spawning.
Aug 01 08:22:25 user nova-compute[72426]: INFO nova.compute.manager [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Took 6.56 seconds to build instance.
Aug 01 08:22:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-17d81bb4-825d-4361-aacb-1a4460098bea tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.660s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG nova.objects.instance [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'flavor' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.124s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:27 user nova-compute[72426]: INFO nova.compute.manager [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Attaching volume 48d014d6-cdb5-4efa-adcf-9cbc69a6026a to /dev/vdb
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:27 user nova-compute[72426]: INFO nova.compute.manager [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Detaching volume 6dbe7101-ebfb-4dfa-8211-c6af5bf20173
Aug 01 08:22:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG os_brick.utils [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0535b3e2-ef13-4ba6-a124-c04091601c14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca3a9e-863d-4ed9-9a27-83345201bac7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: INFO nova.virt.block_device [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Attempting to driver detach volume 6dbe7101-ebfb-4dfa-8211-c6af5bf20173 from mountpoint /dev/vdc
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dcd1d7-a421-4d33-b9aa-999ec3a2a85f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad91e06b-b4fe-4dfd-a557-4f32a22ff4e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Attempting to detach device vdc from instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:22:27 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:22:27 user nova-compute[72426]:   <source dev="/dev/sdi"/>
Aug 01 08:22:27 user nova-compute[72426]:   <target dev="vdc" bus="virtio"/>
Aug 01 08:22:27 user nova-compute[72426]:   <serial>6dbe7101-ebfb-4dfa-8211-c6af5bf20173</serial>
Aug 01 08:22:27 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 08:22:27 user nova-compute[72426]: </disk>
Aug 01 08:22:27 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:22:27 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[add92721-7b5f-46d9-9bb0-963d52287262]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG os_brick.utils [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updating existing volume attachment record: 6f184901-9551-4b6f-9660-f59712f5a45a {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:22:27 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Successfully detached device vdc from instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e from the persistent domain config.
Aug 01 08:22:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:22:27 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:22:27 user nova-compute[72426]:   <source dev="/dev/sdi"/>
Aug 01 08:22:27 user nova-compute[72426]:   <target dev="vdc" bus="virtio"/>
Aug 01 08:22:27 user nova-compute[72426]:   <serial>6dbe7101-ebfb-4dfa-8211-c6af5bf20173</serial>
Aug 01 08:22:27 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 08:22:27 user nova-compute[72426]: </disk>
Aug 01 08:22:27 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878147.9603794, a5e525d1-9cbd-4e92-8eea-f256b6edd86e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:22:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Successfully detached device vdc from instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e from the live domain config.
Aug 01 08:22:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSaWvLBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:22:28 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbd69af-b78b-4830-9c30-c61c3dbe255d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d230288-d9c5-43ff-accb-7295acf02f50]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:28 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:28 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:28 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:22:28 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:28 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:28 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:28 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:28 user nova-compute[72426]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 (non-flash)
Aug 01 08:22:28 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:28 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c3f7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173'): ({'sdi'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Removing single pathed devices sdi {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[878806c3-a435-4cad-8bf5-7103bf195cff]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[deebe893-4be0-422f-81d8-9207666addbf]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Flushing IO for device /dev/sdi {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[535377f8-f97a-4197-9bb4-091622c7780d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.062s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[90af32b7-f3a6-4a92-8b61-fe1f250739d4]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] SCSI volumes sdi have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9595cd-7113-48d0-95d8-e883797267d1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20d5afe-857d-4af8-b9e2-808d8b66bb43]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173, portal: 172.16.0.220,3260]
Aug 01 08:22:28 user nova-compute[72426]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173, portal: 172.16.0.220,3260] successful.
Aug 01 08:22:28 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbe7101-ebfb-4dfa-8211-c6af5bf20173 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b6350e-87b5-4229-b16c-35a8ff42d36f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] <== disconnect_volume: return (383ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'flavor' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1fcda4dc-0f04-4e23-b4ff-584e56fd0758 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.978s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878134.5537775, 711f36c5-6692-4aec-b4fe-0aac97dfef12 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:22:29 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] VM Stopped (Lifecycle Event)
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG nova.compute.manager [None req-208a3cf0-ce87-4d1f-93e6-b5ac9c58da8b None None] [instance: 711f36c5-6692-4aec-b4fe-0aac97dfef12] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:31 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:22:31 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=6771MB free_disk=25.153732299804688GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 73fb06b8-0824-42fc-bbfd-6914bdb78824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance adcf2dea-a758-4e13-9091-fffa6339f670 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance e1119088-18c7-483d-a89d-3b5d19054e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 05637642-f020-48af-b44a-d48e25a598fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2572e472-73fe-4e5a-b486-e38274a978d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance b4d8cd69-296b-4253-badc-75e771af39b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 37dab412-5a15-46e8-844e-2ef0c03b7181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c707f931-d77d-44c8-a352-49e673ff6c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:22:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:22:32 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:22:32 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:22:32 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:22:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwiNoeEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:22:35 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:22:35 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:22:35 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[996790af-b72e-40fd-81f9-ded212734b96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:22:35 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fc4355-8b86-4109-8af3-b40188a709b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a] added
Aug 01 08:22:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7ffc1a-f20a-4a21-a59e-c63a02638cde]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0445bdff-d905-4b77-9722-7d521cd47420]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwiNoeEP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwiNoeEP" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d8669b-2777-4cca-8978-7e80164c36ca]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WwiNoeEP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9a148c-bd13-4120-891e-9fa5fa90465d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[867eecad-4000-4f0f-b7c4-1a1bcea73d41]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcd2a42-7b01-4ac9-8a75-d50de7e56f50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a, portal: 172.16.0.220,3260]
Aug 01 08:22:35 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a, portal: 172.16.0.220,3260] successful.
Aug 01 08:22:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8c119-1f88-4be7-8eac-7bd77e4e830d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03f9689-9ab0-4de1-8aa3-43c04af8e100]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:22:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:35 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:22:35 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ea9329-9eb4-47e6-a986-7b569753d79b]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:22:35 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwiNoeEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:22:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:22:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23235383735376162', 'path': '/dev/sdf'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:22:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235383735376162', 'path': '/dev/sdf'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:22:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'flavor' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:22:36 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:22:36 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:22:36 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:22:36 user nova-compute[72426]:   <serial>48d014d6-cdb5-4efa-adcf-9cbc69a6026a</serial>
Aug 01 08:22:36 user nova-compute[72426]: </disk>
Aug 01 08:22:36 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG nova.objects.instance [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lazy-loading 'info_cache' on Instance uuid c10d6140-aa17-4342-9135-d07a73285483 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] No VIF found with MAC fa:16:3e:eb:91:18, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db949ba4-c757-41b3-9e0b-a97f27e45458 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.284s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updating instance_info_cache with network_info: [{"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-c10d6140-aa17-4342-9135-d07a73285483" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:22:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:22:38 user nova-compute[72426]: INFO nova.compute.manager [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Rescuing
Aug 01 08:22:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:22:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquired lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:22:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:22:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updating instance_info_cache with network_info: [{"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:22:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Releasing lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG nova.compute.manager [req-776d9216-0d36-438a-841e-78655ee5fd51 req-355036eb-462a-4dfb-9026-c65e87f5c167 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-unplugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-776d9216-0d36-438a-841e-78655ee5fd51 req-355036eb-462a-4dfb-9026-c65e87f5c167 service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-776d9216-0d36-438a-841e-78655ee5fd51 req-355036eb-462a-4dfb-9026-c65e87f5c167 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-776d9216-0d36-438a-841e-78655ee5fd51 req-355036eb-462a-4dfb-9026-c65e87f5c167 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG nova.compute.manager [req-776d9216-0d36-438a-841e-78655ee5fd51 req-355036eb-462a-4dfb-9026-c65e87f5c167 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-unplugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:39 user nova-compute[72426]: WARNING nova.compute.manager [req-776d9216-0d36-438a-841e-78655ee5fd51 req-355036eb-462a-4dfb-9026-c65e87f5c167 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-unplugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state active and task_state rescuing.
Aug 01 08:22:39 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Instance destroyed successfully.
Aug 01 08:22:39 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Attempting a stable device rescue
Aug 01 08:22:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72426) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Instance directory exists: not creating {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 08:22:39 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Creating image(s)
Aug 01 08:22:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG nova.objects.instance [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'trusted_certs' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3.part --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3.part --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG nova.virt.images [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] d490aab8-4acd-4a63-9cb1-a1541bd22b41 was qcow2, converting to raw {{(pid=72426) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3.part /opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3.converted {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG nova.compute.manager [req-aee397c9-701f-49df-bc65-4a0ce188b6b8 req-b7b2b3a2-3b02-4f18-a2f1-24379067b724 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-aee397c9-701f-49df-bc65-4a0ce188b6b8 req-b7b2b3a2-3b02-4f18-a2f1-24379067b724 service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-aee397c9-701f-49df-bc65-4a0ce188b6b8 req-b7b2b3a2-3b02-4f18-a2f1-24379067b724 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-aee397c9-701f-49df-bc65-4a0ce188b6b8 req-b7b2b3a2-3b02-4f18-a2f1-24379067b724 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG nova.compute.manager [req-aee397c9-701f-49df-bc65-4a0ce188b6b8 req-b7b2b3a2-3b02-4f18-a2f1-24379067b724 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:41 user nova-compute[72426]: WARNING nova.compute.manager [req-aee397c9-701f-49df-bc65-4a0ce188b6b8 req-b7b2b3a2-3b02-4f18-a2f1-24379067b724 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state active and task_state rescuing.
Aug 01 08:22:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3.part /opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3.converted" returned: 0 in 0.584s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3.converted --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3 --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3,backing_fmt=raw /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3,backing_fmt=raw /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue" returned: 0 in 0.050s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "d5f57f6c8e3a66a5f5baec6d828c18e6b0a4d1a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG nova.objects.instance [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'migration_context' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Start _get_guest_xml network_info=[{"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "vif_mac": "fa:16:3e:eb:91:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd490aab8-4acd-4a63-9cb1-a1541bd22b41', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwiNoeEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '05637642-f020-48af-b44a-d48e25a598fa', 'attached_at': '', 'detached_at': '', 'volume_id': '48d014d6-cdb5-4efa-adcf-9cbc69a6026a', 'serial': '48d014d6-cdb5-4efa-adcf-9cbc69a6026a'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '6f184901-9551-4b6f-9660-f59712f5a45a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.objects.instance [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'resources' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.objects.instance [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'numa_topology' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:42 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:22:42 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.objects.instance [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'vcpu_model' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwiNoeEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:22:42 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:22:42 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:22:42 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[186d3b34-5c99-402a-a30e-c1e1a393e37b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WwiNoeEP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 08:22:42 user nova-compute[72426]: node.name = iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a
Aug 01 08:22:42 user nova-compute[72426]: node.tpgt = -1
Aug 01 08:22:42 user nova-compute[72426]: node.startup = automatic
Aug 01 08:22:42 user nova-compute[72426]: node.leading_login = No
Aug 01 08:22:42 user nova-compute[72426]: iface.iscsi_ifacename = default
Aug 01 08:22:42 user nova-compute[72426]: iface.net_ifacename = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.ipaddress = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.prefix_len = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.hwaddress = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.transport_name = tcp
Aug 01 08:22:42 user nova-compute[72426]: iface.initiatorname = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.state = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.vlan_id = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.vlan_priority = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.vlan_state = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.iface_num = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.mtu = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.port = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.bootproto = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.subnet_mask = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.gateway = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.dhcp_alt_client_id = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.dhcp_dns = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.dhcp_learn_iqn = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.dhcp_vendor_id_state = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.dhcp_vendor_id = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.dhcp_slp_da = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.fragmentation = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.gratuitous_arp = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.incoming_forwarding = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.tos_state = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.tos = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.ttl = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.delayed_ack = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.tcp_nagle = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.tcp_wsf_state = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.tcp_wsf = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.tcp_timer_scale = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.tcp_timestamp = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.redirect = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.def_task_mgmt_timeout = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.header_digest = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.data_digest = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.immediate_data = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.initial_r2t = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.data_seq_inorder = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.data_pdu_inorder = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.erl = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.max_receive_data_len = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.first_burst_len = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.max_outstanding_r2t = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.max_burst_len = 0
Aug 01 08:22:42 user nova-compute[72426]: iface.chap_auth = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.bidi_chap = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.strict_login_compliance = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.discovery_auth = <empty>
Aug 01 08:22:42 user nova-compute[72426]: iface.discovery_logout = <empty>
Aug 01 08:22:42 user nova-compute[72426]: node.discovery_address = <empty>
Aug 01 08:22:42 user nova-compute[72426]: node.discovery_port = 0
Aug 01 08:22:42 user nova-compute[72426]: node.discovery_type = static
Aug 01 08:22:42 user nova-compute[72426]: node.session.initial_cmdsn = 0
Aug 01 08:22:42 user nova-compute[72426]: node.session.initial_login_retry_max = 8
Aug 01 08:22:42 user nova-compute[72426]: node.session.xmit_thread_priority = -20
Aug 01 08:22:42 user nova-compute[72426]: node.session.cmds_max = 128
Aug 01 08:22:42 user nova-compute[72426]: node.session.queue_depth = 32
Aug 01 08:22:42 user nova-compute[72426]: node.session.nr_sessions = 1
Aug 01 08:22:42 user nova-compute[72426]: node.session.auth.authmethod = CHAP
Aug 01 08:22:42 user nova-compute[72426]: node.session.auth.username = WwiNoeEP
Aug 01 08:22:42 user nova-compute[72426]: node.session.auth.password = ***
Aug 01 08:22:42 user nova-compute[72426]: node.session.auth.username_in = <empty>
Aug 01 08:22:42 user nova-compute[72426]: node.session.auth.password_in = <empty>
Aug 01 08:22:42 user nova-compute[72426]: node.session.auth.chap_algs = MD5
Aug 01 08:22:42 user nova-compute[72426]: node.session.timeo.replacement_timeout = 120
Aug 01 08:22:42 user nova-compute[72426]: node.session.err_timeo.abort_timeout = 15
Aug 01 08:22:42 user nova-compute[72426]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 08:22:42 user nova-compute[72426]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 08:22:42 user nova-compute[72426]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 08:22:42 user nova-compute[72426]: node.session.iscsi.FastAbort = Yes
Aug 01 08:22:42 user nova-compute[72426]: node.session.iscsi.InitialR2T = No
Aug 01 08:22:42 user nova-compute[72426]: node.session.iscsi.ImmediateData = Yes
Aug 01 08:22:42 user nova-compute[72426]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 08:22:42 user nova-compute[72426]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 08:22:42 user nova-compute[72426]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 08:22:42 user nova-compute[72426]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 08:22:42 user nova-compute[72426]: node.session.iscsi.MaxConnections = 1
Aug 01 08:22:42 user nova-compute[72426]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 08:22:42 user nova-compute[72426]: node.session.iscsi.ERL = 0
Aug 01 08:22:42 user nova-compute[72426]: node.session.scan = manual
Aug 01 08:22:42 user nova-compute[72426]: node.session.reopen_max = 0
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].address = 172.16.0.220
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].port = 3260
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].startup = manual
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].tcp.window_size = 524288
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].tcp.type_of_service = 0
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].timeo.logout_timeout = 15
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].timeo.login_timeout = 15
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].timeo.auth_timeout = 45
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].iscsi.DataDigest = None
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].iscsi.IFMarker = No
Aug 01 08:22:42 user nova-compute[72426]: node.conn[0].iscsi.OFMarker = No
Aug 01 08:22:42 user nova-compute[72426]: # END RECORD
Aug 01 08:22:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b580fcc4-56d2-4fa8-a09a-9a1a9c9ac221]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc22d36c-a59f-4e1f-88a7-0a5611f7bca3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwiNoeEP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwiNoeEP" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd660250-1336-4d0b-9370-dde9788bd699]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WwiNoeEP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3732f23f-d542-48a8-97c7-60220d6ccd45]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[81636f3e-b09a-4f70-a345-e5e185c57d3a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:42 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:42 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:42 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:42 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:22:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:22:42 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:22:42 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:22:42 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:22:42 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:22:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] HCTL ('37', '0', '0', 0) found on session 36 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d241b4-cca9-49f7-b311-ac2f4205c3d1]: (4, ('0 0 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Searching for a device in session 36 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwiNoeEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.190s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '23235383735376162', 'path': '/dev/sdf'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235383735376162', 'path': '/dev/sdf'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1014751889',display_name='tempest-ServerStableDeviceRescueTest-server-1014751889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1014751889',id=29,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGOczwmFIF55GGK0yKw5W7YLyfKHgYEMleHXa1e7A8MknpSoOlTzKBkR5G0uCw9iSq/ILIoMjQkOSEKackU9urf9ByZ5uU7DY7Bf6h+tbWMKty249vXPajHXhkV+AIjA==',key_name='tempest-keypair-1725080813',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:18:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c67c5b96fae746229b2f90b37110c703',ramdisk_id='',reservation_id='r-nz4656dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2126677985',owner_user_name='tempest-ServerStableDeviceRescueTest-2126677985-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd6a35cf8d4ed786314f9a680fa4cc',uuid=05637642-f020-48af-b44a-d48e25a598fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "vif_mac": "fa:16:3e:eb:91:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Converting VIF {"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "vif_mac": "fa:16:3e:eb:91:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:91:18,bridge_name='br-int',has_traffic_filtering=True,id=a87f8f30-667e-4321-9d19-04f12f45eb7f,network=Network(f0be2463-2fb0-4b0c-aeb2-c36a43962363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87f8f30-66') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.objects.instance [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'pci_devices' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:22:42 user nova-compute[72426]:   <uuid>05637642-f020-48af-b44a-d48e25a598fa</uuid>
Aug 01 08:22:42 user nova-compute[72426]:   <name>instance-0000001d</name>
Aug 01 08:22:42 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:22:42 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:22:42 user nova-compute[72426]:   <metadata>
Aug 01 08:22:42 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:22:42 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:22:42 user nova-compute[72426]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1014751889</nova:name>
Aug 01 08:22:42 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:22:42</nova:creationTime>
Aug 01 08:22:42 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:22:42 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:22:42 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:22:42 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:22:42 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:22:42 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:22:42 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:22:42 user nova-compute[72426]:       <nova:owner>
Aug 01 08:22:42 user nova-compute[72426]:         <nova:user uuid="d6cd6a35cf8d4ed786314f9a680fa4cc">tempest-ServerStableDeviceRescueTest-2126677985-project-member</nova:user>
Aug 01 08:22:42 user nova-compute[72426]:         <nova:project uuid="c67c5b96fae746229b2f90b37110c703">tempest-ServerStableDeviceRescueTest-2126677985</nova:project>
Aug 01 08:22:42 user nova-compute[72426]:       </nova:owner>
Aug 01 08:22:42 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:22:42 user nova-compute[72426]:       <nova:ports>
Aug 01 08:22:42 user nova-compute[72426]:         <nova:port uuid="a87f8f30-667e-4321-9d19-04f12f45eb7f">
Aug 01 08:22:42 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 08:22:42 user nova-compute[72426]:         </nova:port>
Aug 01 08:22:42 user nova-compute[72426]:       </nova:ports>
Aug 01 08:22:42 user nova-compute[72426]:     </nova:instance>
Aug 01 08:22:42 user nova-compute[72426]:   </metadata>
Aug 01 08:22:42 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:22:42 user nova-compute[72426]:     <system>
Aug 01 08:22:42 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:22:42 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:22:42 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:22:42 user nova-compute[72426]:       <entry name="serial">05637642-f020-48af-b44a-d48e25a598fa</entry>
Aug 01 08:22:42 user nova-compute[72426]:       <entry name="uuid">05637642-f020-48af-b44a-d48e25a598fa</entry>
Aug 01 08:22:42 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:22:42 user nova-compute[72426]:     </system>
Aug 01 08:22:42 user nova-compute[72426]:   </sysinfo>
Aug 01 08:22:42 user nova-compute[72426]:   <os>
Aug 01 08:22:42 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:22:42 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:22:42 user nova-compute[72426]:   </os>
Aug 01 08:22:42 user nova-compute[72426]:   <features>
Aug 01 08:22:42 user nova-compute[72426]:     <acpi/>
Aug 01 08:22:42 user nova-compute[72426]:     <apic/>
Aug 01 08:22:42 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:22:42 user nova-compute[72426]:   </features>
Aug 01 08:22:42 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:22:42 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:22:42 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:22:42 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:22:42 user nova-compute[72426]:   </clock>
Aug 01 08:22:42 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:22:42 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:22:42 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:22:42 user nova-compute[72426]:   </cpu>
Aug 01 08:22:42 user nova-compute[72426]:   <devices>
Aug 01 08:22:42 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:22:42 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:22:42 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk"/>
Aug 01 08:22:42 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:22:42 user nova-compute[72426]:     </disk>
Aug 01 08:22:42 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:22:42 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:22:42 user nova-compute[72426]:       <source dev="/dev/sdf"/>
Aug 01 08:22:42 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:22:42 user nova-compute[72426]:       <serial>48d014d6-cdb5-4efa-adcf-9cbc69a6026a</serial>
Aug 01 08:22:42 user nova-compute[72426]:     </disk>
Aug 01 08:22:42 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:22:42 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:22:42 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue"/>
Aug 01 08:22:42 user nova-compute[72426]:       <target dev="vdc" bus="virtio"/>
Aug 01 08:22:42 user nova-compute[72426]:       <boot order="1"/>
Aug 01 08:22:42 user nova-compute[72426]:     </disk>
Aug 01 08:22:42 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:22:42 user nova-compute[72426]:       <mac address="fa:16:3e:eb:91:18"/>
Aug 01 08:22:42 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:22:42 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:22:42 user nova-compute[72426]:       <target dev="tapa87f8f30-66"/>
Aug 01 08:22:42 user nova-compute[72426]:     </interface>
Aug 01 08:22:42 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:22:42 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/console.log" append="off"/>
Aug 01 08:22:42 user nova-compute[72426]:     </serial>
Aug 01 08:22:42 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:22:42 user nova-compute[72426]:     <video>
Aug 01 08:22:42 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:22:42 user nova-compute[72426]:     </video>
Aug 01 08:22:42 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:22:42 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:22:42 user nova-compute[72426]:     </rng>
Aug 01 08:22:42 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:22:42 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:22:42 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:22:42 user nova-compute[72426]:     </memballoon>
Aug 01 08:22:42 user nova-compute[72426]:   </devices>
Aug 01 08:22:42 user nova-compute[72426]: </domain>
Aug 01 08:22:42 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:22:42 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Instance destroyed successfully.
Aug 01 08:22:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:22:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] No VIF found with MAC fa:16:3e:eb:91:18, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:22:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-3facf023-5096-41c8-a22f-8014bf7f37dc req-c1befa46-2b40-4450-a48f-3c78913ab787 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3facf023-5096-41c8-a22f-8014bf7f37dc req-c1befa46-2b40-4450-a48f-3c78913ab787 service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3facf023-5096-41c8-a22f-8014bf7f37dc req-c1befa46-2b40-4450-a48f-3c78913ab787 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3facf023-5096-41c8-a22f-8014bf7f37dc req-c1befa46-2b40-4450-a48f-3c78913ab787 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-3facf023-5096-41c8-a22f-8014bf7f37dc req-c1befa46-2b40-4450-a48f-3c78913ab787 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:44 user nova-compute[72426]: WARNING nova.compute.manager [req-3facf023-5096-41c8-a22f-8014bf7f37dc req-c1befa46-2b40-4450-a48f-3c78913ab787 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state active and task_state rescuing.
Aug 01 08:22:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-7b2b530d-42ac-419e-ae05-3c93f11cbce6 req-9944dd8c-1d82-4823-8cf2-c0909f5c0b71 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7b2b530d-42ac-419e-ae05-3c93f11cbce6 req-9944dd8c-1d82-4823-8cf2-c0909f5c0b71 service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7b2b530d-42ac-419e-ae05-3c93f11cbce6 req-9944dd8c-1d82-4823-8cf2-c0909f5c0b71 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7b2b530d-42ac-419e-ae05-3c93f11cbce6 req-9944dd8c-1d82-4823-8cf2-c0909f5c0b71 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-7b2b530d-42ac-419e-ae05-3c93f11cbce6 req-9944dd8c-1d82-4823-8cf2-c0909f5c0b71 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:46 user nova-compute[72426]: WARNING nova.compute.manager [req-7b2b530d-42ac-419e-ae05-3c93f11cbce6 req-9944dd8c-1d82-4823-8cf2-c0909f5c0b71 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state active and task_state rescuing.
Aug 01 08:22:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for 05637642-f020-48af-b44a-d48e25a598fa due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:22:46 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878166.4447, 05637642-f020-48af-b44a-d48e25a598fa => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:22:46 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] VM Resumed (Lifecycle Event)
Aug 01 08:22:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-db5000d9-1825-41ad-82f6-2f44c6f1d4d7 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:22:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:22:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:22:46 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 08:22:46 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878166.4468024, 05637642-f020-48af-b44a-d48e25a598fa => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:22:46 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] VM Started (Lifecycle Event)
Aug 01 08:22:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:22:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:22:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:50 user nova-compute[72426]: INFO nova.compute.manager [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Terminating instance
Aug 01 08:22:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:22:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-a510b9dc-5512-47e0-b878-9e3bb341f66c req-c91fc068-e8de-4fe5-92d4-a27cfafca7b9 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-vif-unplugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a510b9dc-5512-47e0-b878-9e3bb341f66c req-c91fc068-e8de-4fe5-92d4-a27cfafca7b9 service nova] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a510b9dc-5512-47e0-b878-9e3bb341f66c req-c91fc068-e8de-4fe5-92d4-a27cfafca7b9 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a510b9dc-5512-47e0-b878-9e3bb341f66c req-c91fc068-e8de-4fe5-92d4-a27cfafca7b9 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-a510b9dc-5512-47e0-b878-9e3bb341f66c req-c91fc068-e8de-4fe5-92d4-a27cfafca7b9 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] No waiting events found dispatching network-vif-unplugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-a510b9dc-5512-47e0-b878-9e3bb341f66c req-c91fc068-e8de-4fe5-92d4-a27cfafca7b9 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-vif-unplugged-725650f1-c621-47c2-bb87-a85d41c698d3 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:22:51 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Instance destroyed successfully.
Aug 01 08:22:51 user nova-compute[72426]: DEBUG nova.objects.instance [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'resources' on Instance uuid adcf2dea-a758-4e13-9091-fffa6339f670 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1203897786',display_name='tempest-TestMinimumBasicScenario-server-1203897786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1203897786',id=26,image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaUW+O2gXcs5Qlc9T+gdA+5NS0imiYGw6BG+/0Lan/Dk2AXl3sI2AxVbrhv3fSt5K7N28XqNEPLWtlUEs1dy0X6Wd/7PlKxrwd7J5dxnOgWb2xNIOi/3d+UGC37t1MUHQ==',key_name='tempest-TestMinimumBasicScenario-680132469',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85beb29b81c84c9bb0b49c8bdb107d50',ramdisk_id='',reservation_id='r-k2ymo0md',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6080de30-d80c-4ca7-890f-c3b91f52f7df',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-307605778',owner_user_name='tempest-TestMinimumBasicScenario-307605778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:20:09Z,user_data=None,user_id='46cce858652440719bed7e5473ffb18d',uuid=adcf2dea-a758-4e13-9091-fffa6339f670,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converting VIF {"id": "725650f1-c621-47c2-bb87-a85d41c698d3", "address": "fa:16:3e:48:94:bf", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725650f1-c6", "ovs_interfaceid": "725650f1-c621-47c2-bb87-a85d41c698d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG os_vif [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap725650f1-c6, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:51 user nova-compute[72426]: INFO os_vif [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:94:bf,bridge_name='br-int',has_traffic_filtering=True,id=725650f1-c621-47c2-bb87-a85d41c698d3,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725650f1-c6')
Aug 01 08:22:51 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Deleting instance files /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670_del
Aug 01 08:22:51 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Deletion of /opt/stack/data/nova/instances/adcf2dea-a758-4e13-9091-fffa6339f670_del complete
Aug 01 08:22:51 user nova-compute[72426]: INFO nova.compute.manager [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 08:22:51 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:22:51 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Took 0.69 seconds to deallocate network for instance.
Aug 01 08:22:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:52 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:22:52 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:22:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:52 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Deleted allocations for instance adcf2dea-a758-4e13-9091-fffa6339f670
Aug 01 08:22:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-24f3b445-154a-4e51-a1ec-2e0b60772c56 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "adcf2dea-a758-4e13-9091-fffa6339f670" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.282s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-c091d0d2-bdc1-4bcb-935d-9ab2b87ef159 req-2fd21fcb-1aa5-48ad-850e-b93ad8341ad6 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c091d0d2-bdc1-4bcb-935d-9ab2b87ef159 req-2fd21fcb-1aa5-48ad-850e-b93ad8341ad6 service nova] Acquiring lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:22:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c091d0d2-bdc1-4bcb-935d-9ab2b87ef159 req-2fd21fcb-1aa5-48ad-850e-b93ad8341ad6 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:22:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c091d0d2-bdc1-4bcb-935d-9ab2b87ef159 req-2fd21fcb-1aa5-48ad-850e-b93ad8341ad6 service nova] Lock "adcf2dea-a758-4e13-9091-fffa6339f670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:22:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-c091d0d2-bdc1-4bcb-935d-9ab2b87ef159 req-2fd21fcb-1aa5-48ad-850e-b93ad8341ad6 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] No waiting events found dispatching network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:22:53 user nova-compute[72426]: WARNING nova.compute.manager [req-c091d0d2-bdc1-4bcb-935d-9ab2b87ef159 req-2fd21fcb-1aa5-48ad-850e-b93ad8341ad6 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received unexpected event network-vif-plugged-725650f1-c621-47c2-bb87-a85d41c698d3 for instance with vm_state deleted and task_state None.
Aug 01 08:22:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-c091d0d2-bdc1-4bcb-935d-9ab2b87ef159 req-2fd21fcb-1aa5-48ad-850e-b93ad8341ad6 service nova] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Received event network-vif-deleted-725650f1-c621-47c2-bb87-a85d41c698d3 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:22:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:22:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:02 user nova-compute[72426]: INFO nova.compute.manager [None req-0caabb5f-8027-4538-af43-0d7b59f3e91d tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Get console output
Aug 01 08:23:02 user nova-compute[72426]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 01 08:23:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:05 user nova-compute[72426]: INFO nova.compute.manager [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Terminating instance
Aug 01 08:23:05 user nova-compute[72426]: DEBUG nova.compute.manager [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:23:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-415cc91f-82a8-4be8-ab78-f53ace6e0332 req-f0833335-ba09-4495-abfc-0ea18b5e0e29 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received event network-vif-unplugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-415cc91f-82a8-4be8-ab78-f53ace6e0332 req-f0833335-ba09-4495-abfc-0ea18b5e0e29 service nova] Acquiring lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-415cc91f-82a8-4be8-ab78-f53ace6e0332 req-f0833335-ba09-4495-abfc-0ea18b5e0e29 service nova] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-415cc91f-82a8-4be8-ab78-f53ace6e0332 req-f0833335-ba09-4495-abfc-0ea18b5e0e29 service nova] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-415cc91f-82a8-4be8-ab78-f53ace6e0332 req-f0833335-ba09-4495-abfc-0ea18b5e0e29 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] No waiting events found dispatching network-vif-unplugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-415cc91f-82a8-4be8-ab78-f53ace6e0332 req-f0833335-ba09-4495-abfc-0ea18b5e0e29 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received event network-vif-unplugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878171.0730307, adcf2dea-a758-4e13-9091-fffa6339f670 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:23:06 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] VM Stopped (Lifecycle Event)
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a4d12e7d-c38b-4fbe-adfc-9eebd9ddb13a None None] [instance: adcf2dea-a758-4e13-9091-fffa6339f670] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Instance destroyed successfully.
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.objects.instance [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lazy-loading 'resources' on Instance uuid 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-933736993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-933736993',id=22,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfy+Ue7iG7BvSUL0cdNNUG7/aOrlzMgtbOEm1baGkMuO6M8gkHjWLdy2yw5wsFNexYuXyX62S/LEVFLxRQa3A5fXcFHAmWfacJZZkUz6ZjKu0OZTMQw7Q8mFvY1wezXPQ==',key_name='tempest-keypair-375552062',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:16:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7be045e22d244d6984b171cd0345b6ec',ramdisk_id='',reservation_id='r-mz14ui4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-328470853',owner_user_name='tempest-ServerActionsV293TestJSON-328470853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3b164242dc4336889758526ddabd74',uuid=0acb6dc3-765c-44fb-a06b-a30e5e6948f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converting VIF {"id": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "address": "fa:16:3e:8b:45:2f", "network": {"id": "1e938f81-8561-4858-adfe-0e0ff8f76999", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-390135225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be045e22d244d6984b171cd0345b6ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bf14a4-35", "ovs_interfaceid": "b1bf14a4-3514-48fd-84f4-fdd78ebc5df1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:45:2f,bridge_name='br-int',has_traffic_filtering=True,id=b1bf14a4-3514-48fd-84f4-fdd78ebc5df1,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bf14a4-35') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG os_vif [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:45:2f,bridge_name='br-int',has_traffic_filtering=True,id=b1bf14a4-3514-48fd-84f4-fdd78ebc5df1,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bf14a4-35') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1bf14a4-35, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:23:06 user nova-compute[72426]: INFO os_vif [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:45:2f,bridge_name='br-int',has_traffic_filtering=True,id=b1bf14a4-3514-48fd-84f4-fdd78ebc5df1,network=Network(1e938f81-8561-4858-adfe-0e0ff8f76999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bf14a4-35')
Aug 01 08:23:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Deleting instance files /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3_del
Aug 01 08:23:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Deletion of /opt/stack/data/nova/instances/0acb6dc3-765c-44fb-a06b-a30e5e6948f3_del complete
Aug 01 08:23:06 user nova-compute[72426]: INFO nova.compute.manager [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 08:23:06 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:23:06 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:23:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:07 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:23:07 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Took 0.88 seconds to deallocate network for instance.
Aug 01 08:23:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-6fc6798c-55c7-441f-a2d6-03f431097bd1 req-f4dde83c-5b6c-4b7f-9ffa-c1877a422a27 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received event network-vif-deleted-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:07 user nova-compute[72426]: INFO nova.compute.manager [req-6fc6798c-55c7-441f-a2d6-03f431097bd1 req-f4dde83c-5b6c-4b7f-9ffa-c1877a422a27 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Neutron deleted interface b1bf14a4-3514-48fd-84f4-fdd78ebc5df1; detaching it from the instance and deleting it from the info cache
Aug 01 08:23:07 user nova-compute[72426]: DEBUG nova.network.neutron [req-6fc6798c-55c7-441f-a2d6-03f431097bd1 req-f4dde83c-5b6c-4b7f-9ffa-c1877a422a27 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:23:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-6fc6798c-55c7-441f-a2d6-03f431097bd1 req-f4dde83c-5b6c-4b7f-9ffa-c1877a422a27 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Detach interface failed, port_id=b1bf14a4-3514-48fd-84f4-fdd78ebc5df1, reason: Instance 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:23:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:07 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:23:07 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:23:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:07 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Deleted allocations for instance 0acb6dc3-765c-44fb-a06b-a30e5e6948f3
Aug 01 08:23:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fa3de4cc-d95b-43a1-bbce-10eb5dddff61 tempest-ServerActionsV293TestJSON-328470853 tempest-ServerActionsV293TestJSON-328470853-project-member] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.541s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-748f9141-3337-463d-8963-4ca9f8a4cecd req-52c89f75-470a-4c02-9b3a-4df23334fed5 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received event network-vif-plugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-748f9141-3337-463d-8963-4ca9f8a4cecd req-52c89f75-470a-4c02-9b3a-4df23334fed5 service nova] Acquiring lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-748f9141-3337-463d-8963-4ca9f8a4cecd req-52c89f75-470a-4c02-9b3a-4df23334fed5 service nova] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-748f9141-3337-463d-8963-4ca9f8a4cecd req-52c89f75-470a-4c02-9b3a-4df23334fed5 service nova] Lock "0acb6dc3-765c-44fb-a06b-a30e5e6948f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-748f9141-3337-463d-8963-4ca9f8a4cecd req-52c89f75-470a-4c02-9b3a-4df23334fed5 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] No waiting events found dispatching network-vif-plugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:08 user nova-compute[72426]: WARNING nova.compute.manager [req-748f9141-3337-463d-8963-4ca9f8a4cecd req-52c89f75-470a-4c02-9b3a-4df23334fed5 service nova] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Received unexpected event network-vif-plugged-b1bf14a4-3514-48fd-84f4-fdd78ebc5df1 for instance with vm_state deleted and task_state None.
Aug 01 08:23:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:17 user nova-compute[72426]: INFO nova.compute.manager [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Terminating instance
Aug 01 08:23:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:23:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-70d45104-8415-4ebe-ae62-6b6406371474 req-d8473e75-f4ef-4021-ac27-c770c661372b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-unplugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-70d45104-8415-4ebe-ae62-6b6406371474 req-d8473e75-f4ef-4021-ac27-c770c661372b service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-70d45104-8415-4ebe-ae62-6b6406371474 req-d8473e75-f4ef-4021-ac27-c770c661372b service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-70d45104-8415-4ebe-ae62-6b6406371474 req-d8473e75-f4ef-4021-ac27-c770c661372b service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-70d45104-8415-4ebe-ae62-6b6406371474 req-d8473e75-f4ef-4021-ac27-c770c661372b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-unplugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-70d45104-8415-4ebe-ae62-6b6406371474 req-d8473e75-f4ef-4021-ac27-c770c661372b service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-unplugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:18 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Instance destroyed successfully.
Aug 01 08:23:18 user nova-compute[72426]: DEBUG nova.objects.instance [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'resources' on Instance uuid a5e525d1-9cbd-4e92-8eea-f256b6edd86e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-120743636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-120743636',id=23,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmbPf8dfpbOw3AdFtYviiNgMHzZe3NiBwdcr4xPSbxyQfYaP4IAPXsp+HNXQ2y8gncIZv7OS8P7105AkmU3pmjBBpBNxkZJUuHPFEmhtLWG2TELfES9J3p65QCfv2L7SQ==',key_name='tempest-keypair-1007772321',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-kmty00m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=a5e525d1-9cbd-4e92-8eea-f256b6edd86e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "32122388-a2bc-410d-91f7-594b4702c6a0", "address": "fa:16:3e:a7:2e:e2", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32122388-a2", "ovs_interfaceid": "32122388-a2bc-410d-91f7-594b4702c6a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG os_vif [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32122388-a2, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:23:18 user nova-compute[72426]: INFO os_vif [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2e:e2,bridge_name='br-int',has_traffic_filtering=True,id=32122388-a2bc-410d-91f7-594b4702c6a0,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32122388-a2')
Aug 01 08:23:18 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Deleting instance files /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e_del
Aug 01 08:23:18 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Deletion of /opt/stack/data/nova/instances/a5e525d1-9cbd-4e92-8eea-f256b6edd86e_del complete
Aug 01 08:23:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:18 user nova-compute[72426]: INFO nova.compute.manager [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 08:23:18 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:23:18 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:23:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:20 user nova-compute[72426]: WARNING nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received unexpected event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with vm_state active and task_state deleting.
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:20 user nova-compute[72426]: WARNING nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received unexpected event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with vm_state active and task_state deleting.
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:20 user nova-compute[72426]: WARNING nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received unexpected event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with vm_state active and task_state deleting.
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-unplugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-unplugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-0821c9ee-b6f5-45e3-a68b-22a313cf5ec7 req-44eec942-2640-4657-92d3-9e380678921e service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-unplugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:23:20 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Took 1.70 seconds to deallocate network for instance.
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:20 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Deleted allocations for instance a5e525d1-9cbd-4e92-8eea-f256b6edd86e
Aug 01 08:23:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-8e783c17-27a9-48a6-8bd6-e066283f4578 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.182s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:21 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878186.3606892, 0acb6dc3-765c-44fb-a06b-a30e5e6948f3 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:23:21 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] VM Stopped (Lifecycle Event)
Aug 01 08:23:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-0516488b-4dcc-4ba0-9ab4-aa1dd7ffab33 None None] [instance: 0acb6dc3-765c-44fb-a06b-a30e5e6948f3] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-c1fb4f68-e36c-4e00-b14d-0113e7acc8b2 req-e8ea98b5-143a-45fa-b3b1-aa85737dc707 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c1fb4f68-e36c-4e00-b14d-0113e7acc8b2 req-e8ea98b5-143a-45fa-b3b1-aa85737dc707 service nova] Acquiring lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c1fb4f68-e36c-4e00-b14d-0113e7acc8b2 req-e8ea98b5-143a-45fa-b3b1-aa85737dc707 service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c1fb4f68-e36c-4e00-b14d-0113e7acc8b2 req-e8ea98b5-143a-45fa-b3b1-aa85737dc707 service nova] Lock "a5e525d1-9cbd-4e92-8eea-f256b6edd86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-c1fb4f68-e36c-4e00-b14d-0113e7acc8b2 req-e8ea98b5-143a-45fa-b3b1-aa85737dc707 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] No waiting events found dispatching network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:22 user nova-compute[72426]: WARNING nova.compute.manager [req-c1fb4f68-e36c-4e00-b14d-0113e7acc8b2 req-e8ea98b5-143a-45fa-b3b1-aa85737dc707 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received unexpected event network-vif-plugged-32122388-a2bc-410d-91f7-594b4702c6a0 for instance with vm_state deleted and task_state None.
Aug 01 08:23:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-c1fb4f68-e36c-4e00-b14d-0113e7acc8b2 req-e8ea98b5-143a-45fa-b3b1-aa85737dc707 service nova] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Received event network-vif-deleted-32122388-a2bc-410d-91f7-594b4702c6a0 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:23:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a43f967-d450-4344-a064-7b88329f56e8 req-8ed28b8e-d65a-4b8a-a014-cef301d75e55 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received event network-changed-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-6a43f967-d450-4344-a064-7b88329f56e8 req-8ed28b8e-d65a-4b8a-a014-cef301d75e55 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Refreshing instance network info cache due to event network-changed-95cc6db7-744d-477c-b1d4-31ed03169092. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a43f967-d450-4344-a064-7b88329f56e8 req-8ed28b8e-d65a-4b8a-a014-cef301d75e55 service nova] Acquiring lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a43f967-d450-4344-a064-7b88329f56e8 req-8ed28b8e-d65a-4b8a-a014-cef301d75e55 service nova] Acquired lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG nova.network.neutron [req-6a43f967-d450-4344-a064-7b88329f56e8 req-8ed28b8e-d65a-4b8a-a014-cef301d75e55 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Refreshing network info cache for port 95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG nova.network.neutron [req-6a43f967-d450-4344-a064-7b88329f56e8 req-8ed28b8e-d65a-4b8a-a014-cef301d75e55 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updated VIF entry in instance network info cache for port 95cc6db7-744d-477c-b1d4-31ed03169092. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG nova.network.neutron [req-6a43f967-d450-4344-a064-7b88329f56e8 req-8ed28b8e-d65a-4b8a-a014-cef301d75e55 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updating instance_info_cache with network_info: [{"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:23:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6a43f967-d450-4344-a064-7b88329f56e8 req-8ed28b8e-d65a-4b8a-a014-cef301d75e55 service nova] Releasing lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG nova.objects.instance [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'flavor' on Instance uuid 37dab412-5a15-46e8-844e-2ef0c03b7181 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:29 user nova-compute[72426]: INFO nova.compute.manager [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Attaching volume bc1f34f0-3724-453f-b4d1-16a1b77d1a42 to /dev/vdb
Aug 01 08:23:29 user nova-compute[72426]: DEBUG os_brick.utils [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[050b4c75-6ea9-4ab1-94c9-a7225eb6ba2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7f145-76ea-464b-a24b-d97c2652a7d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d690ebc4-0901-4a3d-87a7-846fd934969d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[89910719-d28d-42e7-a618-7b69fae428be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:23:29 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ded921-8f3c-431c-8a86-a2c35e3c53c5]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG os_brick.utils [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updating existing volume attachment record: 56cd6c8f-2fc4-4cd8-8091-dc385a6e7caa {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:31 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:23:31 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=6977MB free_disk=25.110336303710938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 73fb06b8-0824-42fc-bbfd-6914bdb78824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance e1119088-18c7-483d-a89d-3b5d19054e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 05637642-f020-48af-b44a-d48e25a598fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 2572e472-73fe-4e5a-b486-e38274a978d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance b4d8cd69-296b-4253-badc-75e771af39b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 37dab412-5a15-46e8-844e-2ef0c03b7181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c707f931-d77d-44c8-a352-49e673ff6c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:23:31 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:23:32 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:23:32 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:23:32 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:23:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:33 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878198.490267, a5e525d1-9cbd-4e92-8eea-f256b6edd86e => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:23:33 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] VM Stopped (Lifecycle Event)
Aug 01 08:23:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c5136202-9429-4f21-81a5-f39643aa981f None None] [instance: a5e525d1-9cbd-4e92-8eea-f256b6edd86e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:34 user nova-compute[72426]: INFO nova.compute.manager [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Detaching volume de3d896b-64bc-473a-a1d3-090164bd228e
Aug 01 08:23:34 user nova-compute[72426]: INFO nova.virt.block_device [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Attempting to driver detach volume de3d896b-64bc-473a-a1d3-090164bd228e from mountpoint /dev/vdb
Aug 01 08:23:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Attempting to detach device vdb from instance e1119088-18c7-483d-a89d-3b5d19054e52 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:23:34 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:23:34 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:23:34 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:23:34 user nova-compute[72426]:   <serial>de3d896b-64bc-473a-a1d3-090164bd228e</serial>
Aug 01 08:23:34 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 08:23:34 user nova-compute[72426]: </disk>
Aug 01 08:23:34 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:23:34 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully detached device vdb from instance e1119088-18c7-483d-a89d-3b5d19054e52 from the persistent domain config.
Aug 01 08:23:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1119088-18c7-483d-a89d-3b5d19054e52 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:23:34 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:23:34 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:23:34 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:23:34 user nova-compute[72426]:   <serial>de3d896b-64bc-473a-a1d3-090164bd228e</serial>
Aug 01 08:23:34 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 08:23:34 user nova-compute[72426]: </disk>
Aug 01 08:23:34 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878214.6521912, e1119088-18c7-483d-a89d-3b5d19054e52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:23:34 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully detached device vdb from instance e1119088-18c7-483d-a89d-3b5d19054e52 from the live domain config.
Aug 01 08:23:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtroyQLi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:23:34 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d8c2dd-5e6b-4f5a-b647-ee00dc9f421a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91c8e4c-c0d2-4ea1-b71d-76fb1979af89]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:23:34 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:23:34 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:23:34 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:23:34 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:23:34 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:23:34 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:23:34 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:23:34 user nova-compute[72426]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e (non-flash)
Aug 01 08:23:34 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:23:34 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38fe2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c548281-a522-4abe-9d42-9d34ca6f7126]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[47921962-8acf-42ff-bc9f-6bd8bd43e3b9]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4513c2-2e0d-425c-9585-5eb0a5d80ee7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d868cdae-c662-475a-b23a-89f8b62606a3]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca89867-a04b-465b-8b27-663403295490]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f288b3c1-1589-481a-a6a8-c62eec00bff4]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260]
Aug 01 08:23:34 user nova-compute[72426]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e, portal: 172.16.0.220,3260] successful.
Aug 01 08:23:34 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3d896b-64bc-473a-a1d3-090164bd228e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9176470-0300-4e88-988e-67239dcd213e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== disconnect_volume: return (288ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:23:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updating instance_info_cache with network_info: [{"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-df66e0b7-acbf-48a2-b165-7d4a4fbf790d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:23:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:23:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:23:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:23:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HhwnjGDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:23:41 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:23:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:23:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:23:41 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:23:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:23:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:23:41 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:23:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:41 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3f5721-b2ca-4e62-b84c-daef5873b772]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:41 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:23:41 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbb52ec-af01-46f4-98e7-42be5a6854fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42] added
Aug 01 08:23:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e3efe9-57ad-47b5-b5c5-7373dc5d5e3d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c29fd6-74b5-40f7-9082-ee6a86d72bf6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HhwnjGDf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HhwnjGDf" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca224cea-b110-47a6-8cb1-f43dfc91beac]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HhwnjGDf'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea2f7a-a084-4d1a-9198-b70518967b62]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddc69c7-6c54-411f-8819-36dc7b563cc5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46c841d-604a-408f-b88e-d2637e8a2dfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42, portal: 172.16.0.220,3260]
Aug 01 08:23:42 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42, portal: 172.16.0.220,3260] successful.
Aug 01 08:23:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78ef460-5c66-49bc-88b7-eecf206e9691]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG nova.objects.instance [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[353ab7bf-ecba-4a90-b924-f6246ad33624]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 (non-flash)
Aug 01 08:23:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:23:42 user nova-compute[72426]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 (non-flash)
Aug 01 08:23:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4ea9b816-caf3-469a-a7cb-64ee5c2b62fe tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.306s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ce657-b101-4d6c-8196-2fd1b8875417]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HhwnjGDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad8dfe3e-66f4-4a20-9b48-ae8bb9d5ac76 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad8dfe3e-66f4-4a20-9b48-ae8bb9d5ac76 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ad8dfe3e-66f4-4a20-9b48-ae8bb9d5ac76 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ad8dfe3e-66f4-4a20-9b48-ae8bb9d5ac76 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72426) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ad8dfe3e-66f4-4a20-9b48-ae8bb9d5ac76 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG nova.compute.manager [req-9ce961b0-76f7-48df-a1d5-d2972cc50b82 req-f1a312d1-71f4-401a-a9b1-dbcb8a15887e service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9ce961b0-76f7-48df-a1d5-d2972cc50b82 req-f1a312d1-71f4-401a-a9b1-dbcb8a15887e service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9ce961b0-76f7-48df-a1d5-d2972cc50b82 req-f1a312d1-71f4-401a-a9b1-dbcb8a15887e service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9ce961b0-76f7-48df-a1d5-d2972cc50b82 req-f1a312d1-71f4-401a-a9b1-dbcb8a15887e service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:42 user nova-compute[72426]: DEBUG nova.compute.manager [req-9ce961b0-76f7-48df-a1d5-d2972cc50b82 req-f1a312d1-71f4-401a-a9b1-dbcb8a15887e service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:42 user nova-compute[72426]: WARNING nova.compute.manager [req-9ce961b0-76f7-48df-a1d5-d2972cc50b82 req-f1a312d1-71f4-401a-a9b1-dbcb8a15887e service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state active and task_state powering-off.
Aug 01 08:23:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:23:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23230646230366466', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:23:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230646230366466', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:23:43 user nova-compute[72426]: DEBUG nova.objects.instance [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'flavor' on Instance uuid 37dab412-5a15-46e8-844e-2ef0c03b7181 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:23:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:23:43 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:23:43 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:23:43 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:23:43 user nova-compute[72426]:   <serial>bc1f34f0-3724-453f-b4d1-16a1b77d1a42</serial>
Aug 01 08:23:43 user nova-compute[72426]: </disk>
Aug 01 08:23:43 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:23:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance destroyed successfully.
Aug 01 08:23:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ad8dfe3e-66f4-4a20-9b48-ae8bb9d5ac76 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ad8dfe3e-66f4-4a20-9b48-ae8bb9d5ac76 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.840s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:23:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:23:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] No VIF found with MAC fa:16:3e:bb:2f:46, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:23:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-caca655d-a1e7-4b00-9348-dff1ea00104a tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.668s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:23:44 user nova-compute[72426]: INFO nova.compute.claims [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Claim successful on node user
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:23:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-7ce866a9-4e4d-4330-a645-cbd722e57fcc req-7a2c150b-45c5-4d13-be45-d17026c30442 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7ce866a9-4e4d-4330-a645-cbd722e57fcc req-7a2c150b-45c5-4d13-be45-d17026c30442 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7ce866a9-4e4d-4330-a645-cbd722e57fcc req-7a2c150b-45c5-4d13-be45-d17026c30442 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7ce866a9-4e4d-4330-a645-cbd722e57fcc req-7a2c150b-45c5-4d13-be45-d17026c30442 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-7ce866a9-4e4d-4330-a645-cbd722e57fcc req-7a2c150b-45c5-4d13-be45-d17026c30442 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:44 user nova-compute[72426]: WARNING nova.compute.manager [req-7ce866a9-4e4d-4330-a645-cbd722e57fcc req-7a2c150b-45c5-4d13-be45-d17026c30442 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state stopped and task_state None.
Aug 01 08:23:44 user nova-compute[72426]: DEBUG nova.policy [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46cce858652440719bed7e5473ffb18d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beb29b81c84c9bb0b49c8bdb107d50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:23:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Creating image(s)
Aug 01 08:23:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "/opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "/opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f.part --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Successfully created port: 1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f.part --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG nova.virt.images [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] 5f3d6662-bb1e-4878-9dae-d93bf4d642f7 was qcow2, converting to raw {{(pid=72426) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f.part /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f.converted {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f.part /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f.converted" returned: 0 in 0.283s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f.converted --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f.converted --force-share --output=json" returned: 0 in 0.275s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.231s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:46 user nova-compute[72426]: INFO nova.compute.manager [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Detaching volume bc1f34f0-3724-453f-b4d1-16a1b77d1a42
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f,backing_fmt=raw /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:46 user nova-compute[72426]: INFO nova.virt.block_device [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Attempting to driver detach volume bc1f34f0-3724-453f-b4d1-16a1b77d1a42 from mountpoint /dev/vdb
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f,backing_fmt=raw /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk 1073741824" returned: 0 in 0.049s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Attempting to detach device vdb from instance 37dab412-5a15-46e8-844e-2ef0c03b7181 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:23:46 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:23:46 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:23:46 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:23:46 user nova-compute[72426]:   <serial>bc1f34f0-3724-453f-b4d1-16a1b77d1a42</serial>
Aug 01 08:23:46 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:23:46 user nova-compute[72426]: </disk>
Aug 01 08:23:46 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:23:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Successfully detached device vdb from instance 37dab412-5a15-46e8-844e-2ef0c03b7181 from the persistent domain config.
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37dab412-5a15-46e8-844e-2ef0c03b7181 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:23:46 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:23:46 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:23:46 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:23:46 user nova-compute[72426]:   <serial>bc1f34f0-3724-453f-b4d1-16a1b77d1a42</serial>
Aug 01 08:23:46 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:23:46 user nova-compute[72426]: </disk>
Aug 01 08:23:46 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Successfully updated port: 1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2413cc3ed46a3bdd3454e6a9d5d62d52357ed33f --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquired lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-a43d61c9-af7b-4ceb-9447-1944aac6884b req-24873914-9da4-463e-851a-e9d451856db9 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-changed-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-a43d61c9-af7b-4ceb-9447-1944aac6884b req-24873914-9da4-463e-851a-e9d451856db9 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Refreshing instance network info cache due to event network-changed-1705fdbb-5832-4b95-8bde-3ba0de7a4f34. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a43d61c9-af7b-4ceb-9447-1944aac6884b req-24873914-9da4-463e-851a-e9d451856db9 service nova] Acquiring lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Cannot resize image /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'migration_context' on Instance uuid bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Ensure instance console log exists: /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updating instance_info_cache with network_info: [{"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878227.144466, 37dab412-5a15-46e8-844e-2ef0c03b7181 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37dab412-5a15-46e8-844e-2ef0c03b7181 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:23:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Successfully detached device vdb from instance 37dab412-5a15-46e8-844e-2ef0c03b7181 from the live domain config.
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HhwnjGDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:23:47 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Releasing lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Instance network_info: |[{"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a43d61c9-af7b-4ceb-9447-1944aac6884b req-24873914-9da4-463e-851a-e9d451856db9 service nova] Acquired lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.network.neutron [req-a43d61c9-af7b-4ceb-9447-1944aac6884b req-24873914-9da4-463e-851a-e9d451856db9 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Refreshing network info cache for port 1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Start _get_guest_xml network_info=[{"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:23:41Z,direct_url=<?>,disk_format='qcow2',id=5f3d6662-bb1e-4878-9dae-d93bf4d642f7,min_disk=0,min_ram=0,name='tempest-scenario-img--780727580',owner='85beb29b81c84c9bb0b49c8bdb107d50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:23:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5f3d6662-bb1e-4878-9dae-d93bf4d642f7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:47 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:23:47 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cc1901-2f21-44be-b5a6-1f6b17f04989]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:23:41Z,direct_url=<?>,disk_format='qcow2',id=5f3d6662-bb1e-4878-9dae-d93bf4d642f7,min_disk=0,min_ram=0,name='tempest-scenario-img--780727580',owner='85beb29b81c84c9bb0b49c8bdb107d50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:23:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-713742802',display_name='tempest-TestMinimumBasicScenario-server-713742802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-713742802',id=35,image_ref='5f3d6662-bb1e-4878-9dae-d93bf4d642f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9cZsXgLKIFvJtPur+0xMN2AHirOZy+Uxlt6KnLj3FvFu1sI2/MGyLmoimBizhW7oGZNQgC+4yujZSgtPVyAD4iJ1ol27Qxotbm1/GPaQ/JgkjKgHPubz/QKEhNLMtDYg==',key_name='tempest-TestMinimumBasicScenario-50015426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85beb29b81c84c9bb0b49c8bdb107d50',ramdisk_id='',reservation_id='r-209t74tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f3d6662-bb1e-4878-9dae-d93bf4d642f7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-307605778',owner_user_name='tempest-TestMinimumBasicScenario-307605778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:23:45Z,user_data=None,user_id='46cce858652440719bed7e5473ffb18d',uuid=bb481b39-3c20-48f5-ad4a-0b755e9ca9f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converting VIF {"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:be:c4,bridge_name='br-int',has_traffic_filtering=True,id=1705fdbb-5832-4b95-8bde-3ba0de7a4f34,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1705fdbb-58') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.objects.instance [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'pci_devices' on Instance uuid bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f63bd68-311d-4b9c-88ec-81a8c3594209]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:23:47 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:23:47 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:23:47 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:23:47 user nova-compute[72426]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 (non-flash)
Aug 01 08:23:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:23:47 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:23:47 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:23:47 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:23:47 user nova-compute[72426]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 (non-flash)
Aug 01 08:23:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38c4f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:23:47 user nova-compute[72426]:   <uuid>bb481b39-3c20-48f5-ad4a-0b755e9ca9f8</uuid>
Aug 01 08:23:47 user nova-compute[72426]:   <name>instance-00000023</name>
Aug 01 08:23:47 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:23:47 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:23:47 user nova-compute[72426]:   <metadata>
Aug 01 08:23:47 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:23:47 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:23:47 user nova-compute[72426]:       <nova:name>tempest-TestMinimumBasicScenario-server-713742802</nova:name>
Aug 01 08:23:47 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:23:47</nova:creationTime>
Aug 01 08:23:47 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:23:47 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:23:47 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:23:47 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:23:47 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:23:47 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:23:47 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:23:47 user nova-compute[72426]:       <nova:owner>
Aug 01 08:23:47 user nova-compute[72426]:         <nova:user uuid="46cce858652440719bed7e5473ffb18d">tempest-TestMinimumBasicScenario-307605778-project-member</nova:user>
Aug 01 08:23:47 user nova-compute[72426]:         <nova:project uuid="85beb29b81c84c9bb0b49c8bdb107d50">tempest-TestMinimumBasicScenario-307605778</nova:project>
Aug 01 08:23:47 user nova-compute[72426]:       </nova:owner>
Aug 01 08:23:47 user nova-compute[72426]:       <nova:root type="image" uuid="5f3d6662-bb1e-4878-9dae-d93bf4d642f7"/>
Aug 01 08:23:47 user nova-compute[72426]:       <nova:ports>
Aug 01 08:23:47 user nova-compute[72426]:         <nova:port uuid="1705fdbb-5832-4b95-8bde-3ba0de7a4f34">
Aug 01 08:23:47 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 08:23:47 user nova-compute[72426]:         </nova:port>
Aug 01 08:23:47 user nova-compute[72426]:       </nova:ports>
Aug 01 08:23:47 user nova-compute[72426]:     </nova:instance>
Aug 01 08:23:47 user nova-compute[72426]:   </metadata>
Aug 01 08:23:47 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:23:47 user nova-compute[72426]:     <system>
Aug 01 08:23:47 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:23:47 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:23:47 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:23:47 user nova-compute[72426]:       <entry name="serial">bb481b39-3c20-48f5-ad4a-0b755e9ca9f8</entry>
Aug 01 08:23:47 user nova-compute[72426]:       <entry name="uuid">bb481b39-3c20-48f5-ad4a-0b755e9ca9f8</entry>
Aug 01 08:23:47 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:23:47 user nova-compute[72426]:     </system>
Aug 01 08:23:47 user nova-compute[72426]:   </sysinfo>
Aug 01 08:23:47 user nova-compute[72426]:   <os>
Aug 01 08:23:47 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:23:47 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:23:47 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:23:47 user nova-compute[72426]:   </os>
Aug 01 08:23:47 user nova-compute[72426]:   <features>
Aug 01 08:23:47 user nova-compute[72426]:     <acpi/>
Aug 01 08:23:47 user nova-compute[72426]:     <apic/>
Aug 01 08:23:47 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:23:47 user nova-compute[72426]:   </features>
Aug 01 08:23:47 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:23:47 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:23:47 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:23:47 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:23:47 user nova-compute[72426]:   </clock>
Aug 01 08:23:47 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:23:47 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:23:47 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:23:47 user nova-compute[72426]:   </cpu>
Aug 01 08:23:47 user nova-compute[72426]:   <devices>
Aug 01 08:23:47 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:23:47 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:23:47 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk"/>
Aug 01 08:23:47 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:23:47 user nova-compute[72426]:     </disk>
Aug 01 08:23:47 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:23:47 user nova-compute[72426]:       <mac address="fa:16:3e:21:be:c4"/>
Aug 01 08:23:47 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:23:47 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:23:47 user nova-compute[72426]:       <target dev="tap1705fdbb-58"/>
Aug 01 08:23:47 user nova-compute[72426]:     </interface>
Aug 01 08:23:47 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:23:47 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/console.log" append="off"/>
Aug 01 08:23:47 user nova-compute[72426]:     </serial>
Aug 01 08:23:47 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:23:47 user nova-compute[72426]:     <video>
Aug 01 08:23:47 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:23:47 user nova-compute[72426]:     </video>
Aug 01 08:23:47 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:23:47 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:23:47 user nova-compute[72426]:     </rng>
Aug 01 08:23:47 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:23:47 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:23:47 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:23:47 user nova-compute[72426]:     </memballoon>
Aug 01 08:23:47 user nova-compute[72426]:   </devices>
Aug 01 08:23:47 user nova-compute[72426]: </domain>
Aug 01 08:23:47 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-713742802',display_name='tempest-TestMinimumBasicScenario-server-713742802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-713742802',id=35,image_ref='5f3d6662-bb1e-4878-9dae-d93bf4d642f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9cZsXgLKIFvJtPur+0xMN2AHirOZy+Uxlt6KnLj3FvFu1sI2/MGyLmoimBizhW7oGZNQgC+4yujZSgtPVyAD4iJ1ol27Qxotbm1/GPaQ/JgkjKgHPubz/QKEhNLMtDYg==',key_name='tempest-TestMinimumBasicScenario-50015426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85beb29b81c84c9bb0b49c8bdb107d50',ramdisk_id='',reservation_id='r-209t74tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f3d6662-bb1e-4878-9dae-d93bf4d642f7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-307605778',owner_user_name='tempest-TestMinimumBasicScenario-307605778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:23:45Z,user_data=None,user_id='46cce858652440719bed7e5473ffb18d',uuid=bb481b39-3c20-48f5-ad4a-0b755e9ca9f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converting VIF {"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:be:c4,bridge_name='br-int',has_traffic_filtering=True,id=1705fdbb-5832-4b95-8bde-3ba0de7a4f34,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1705fdbb-58') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_vif [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:be:c4,bridge_name='br-int',has_traffic_filtering=True,id=1705fdbb-5832-4b95-8bde-3ba0de7a4f34,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1705fdbb-58') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1705fdbb-58, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1705fdbb-58, col_values=(('external_ids', {'iface-id': '1705fdbb-5832-4b95-8bde-3ba0de7a4f34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:be:c4', 'vm-uuid': 'bb481b39-3c20-48f5-ad4a-0b755e9ca9f8'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c663eaf-5620-404b-8323-85ef4c47f6dd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:47 user nova-compute[72426]: INFO os_vif [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:be:c4,bridge_name='br-int',has_traffic_filtering=True,id=1705fdbb-5832-4b95-8bde-3ba0de7a4f34,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1705fdbb-58')
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88c16f6-306c-4ecd-8c4f-ddf4d5c25c79]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe00e70-6985-4de0-815f-09de62e04a6e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] No VIF found with MAC fa:16:3e:21:be:c4, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a3ff02-42a2-4f04-aaf8-2f9f4a9c2a47]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90c99ca-6841-4745-8179-26516a91bb18]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf3189c-763e-4785-8319-e94fb156b54e]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42, portal: 172.16.0.220,3260]
Aug 01 08:23:47 user nova-compute[72426]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42, portal: 172.16.0.220,3260] successful.
Aug 01 08:23:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1f34f0-3724-453f-b4d1-16a1b77d1a42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bc077f-68cd-44b3-95e7-4fe0be8aed5a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] <== disconnect_volume: return (325ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.network.neutron [req-a43d61c9-af7b-4ceb-9447-1944aac6884b req-24873914-9da4-463e-851a-e9d451856db9 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updated VIF entry in instance network info cache for port 1705fdbb-5832-4b95-8bde-3ba0de7a4f34. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG nova.network.neutron [req-a43d61c9-af7b-4ceb-9447-1944aac6884b req-24873914-9da4-463e-851a-e9d451856db9 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updating instance_info_cache with network_info: [{"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:23:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a43d61c9-af7b-4ceb-9447-1944aac6884b req-24873914-9da4-463e-851a-e9d451856db9 service nova] Releasing lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG nova.objects.instance [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'flavor' on Instance uuid 37dab412-5a15-46e8-844e-2ef0c03b7181 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-35dc52d9-55c4-4b5c-93d0-8cf7e9fda7f8 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.805s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-d8fefbab-e480-406e-93e8-4ea27eae37a3 req-4e69488c-7bfd-4545-b6f9-64b53c684555 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d8fefbab-e480-406e-93e8-4ea27eae37a3 req-4e69488c-7bfd-4545-b6f9-64b53c684555 service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d8fefbab-e480-406e-93e8-4ea27eae37a3 req-4e69488c-7bfd-4545-b6f9-64b53c684555 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d8fefbab-e480-406e-93e8-4ea27eae37a3 req-4e69488c-7bfd-4545-b6f9-64b53c684555 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-d8fefbab-e480-406e-93e8-4ea27eae37a3 req-4e69488c-7bfd-4545-b6f9-64b53c684555 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:48 user nova-compute[72426]: WARNING nova.compute.manager [req-d8fefbab-e480-406e-93e8-4ea27eae37a3 req-4e69488c-7bfd-4545-b6f9-64b53c684555 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received unexpected event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with vm_state building and task_state spawning.
Aug 01 08:23:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878230.761942, bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:23:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] VM Resumed (Lifecycle Event)
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:23:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Instance spawned successfully.
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:23:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878230.7634456, bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:23:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] VM Started (Lifecycle Event)
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:23:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:23:50 user nova-compute[72426]: INFO nova.compute.manager [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Took 5.84 seconds to spawn the instance on the hypervisor.
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-ff052701-dd6b-483e-8c01-843f72a02723 req-a1db47b6-29c0-4853-b763-382e70f358bc service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ff052701-dd6b-483e-8c01-843f72a02723 req-a1db47b6-29c0-4853-b763-382e70f358bc service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ff052701-dd6b-483e-8c01-843f72a02723 req-a1db47b6-29c0-4853-b763-382e70f358bc service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ff052701-dd6b-483e-8c01-843f72a02723 req-a1db47b6-29c0-4853-b763-382e70f358bc service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-ff052701-dd6b-483e-8c01-843f72a02723 req-a1db47b6-29c0-4853-b763-382e70f358bc service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:50 user nova-compute[72426]: WARNING nova.compute.manager [req-ff052701-dd6b-483e-8c01-843f72a02723 req-a1db47b6-29c0-4853-b763-382e70f358bc service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received unexpected event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with vm_state building and task_state spawning.
Aug 01 08:23:50 user nova-compute[72426]: INFO nova.compute.manager [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Took 6.54 seconds to build instance.
Aug 01 08:23:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a4a973ed-f4fd-42e2-bb10-055af2d54254 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.648s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:52 user nova-compute[72426]: INFO nova.compute.manager [None req-2a653dd6-083e-4c9c-b8b0-01e1e4ca48fc tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Unrescuing
Aug 01 08:23:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2a653dd6-083e-4c9c-b8b0-01e1e4ca48fc tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:23:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2a653dd6-083e-4c9c-b8b0-01e1e4ca48fc tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquired lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:23:52 user nova-compute[72426]: DEBUG nova.network.neutron [None req-2a653dd6-083e-4c9c-b8b0-01e1e4ca48fc tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG nova.network.neutron [None req-2a653dd6-083e-4c9c-b8b0-01e1e4ca48fc tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Updating instance_info_cache with network_info: [{"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2a653dd6-083e-4c9c-b8b0-01e1e4ca48fc tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Releasing lock "refresh_cache-b4d8cd69-296b-4253-badc-75e771af39b8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2a653dd6-083e-4c9c-b8b0-01e1e4ca48fc tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'flavor' on Instance uuid b4d8cd69-296b-4253-badc-75e771af39b8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-ad7270cc-e30a-4f99-b263-a284f08d6dac req-39d47a1b-8ea1-43e4-a88c-dee6f1f9bf60 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-unplugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ad7270cc-e30a-4f99-b263-a284f08d6dac req-39d47a1b-8ea1-43e4-a88c-dee6f1f9bf60 service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ad7270cc-e30a-4f99-b263-a284f08d6dac req-39d47a1b-8ea1-43e4-a88c-dee6f1f9bf60 service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ad7270cc-e30a-4f99-b263-a284f08d6dac req-39d47a1b-8ea1-43e4-a88c-dee6f1f9bf60 service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-ad7270cc-e30a-4f99-b263-a284f08d6dac req-39d47a1b-8ea1-43e4-a88c-dee6f1f9bf60 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-unplugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:53 user nova-compute[72426]: WARNING nova.compute.manager [req-ad7270cc-e30a-4f99-b263-a284f08d6dac req-39d47a1b-8ea1-43e4-a88c-dee6f1f9bf60 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-unplugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:23:54 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Instance destroyed successfully.
Aug 01 08:23:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:56 user nova-compute[72426]: WARNING nova.compute.manager [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:23:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:56 user nova-compute[72426]: WARNING nova.compute.manager [req-356be617-f7ee-4b1c-a299-a45316ae3def req-81921529-1252-4674-8a31-1e7d336dd90d service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:23:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:23:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for b4d8cd69-296b-4253-badc-75e771af39b8 due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:23:57 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878237.8360686, b4d8cd69-296b-4253-badc-75e771af39b8 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:23:57 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] VM Resumed (Lifecycle Event)
Aug 01 08:23:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2a653dd6-083e-4c9c-b8b0-01e1e4ca48fc tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:23:57 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 08:23:57 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878237.8378766, b4d8cd69-296b-4253-badc-75e771af39b8 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:23:57 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] VM Started (Lifecycle Event)
Aug 01 08:23:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:57 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:23:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-b89dafe8-d9eb-4c76-b3bd-e2c6f8cca0ee req-a9b5b01c-0430-4ed8-9f79-734579bb1198 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:23:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b89dafe8-d9eb-4c76-b3bd-e2c6f8cca0ee req-a9b5b01c-0430-4ed8-9f79-734579bb1198 service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:23:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b89dafe8-d9eb-4c76-b3bd-e2c6f8cca0ee req-a9b5b01c-0430-4ed8-9f79-734579bb1198 service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:23:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b89dafe8-d9eb-4c76-b3bd-e2c6f8cca0ee req-a9b5b01c-0430-4ed8-9f79-734579bb1198 service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:23:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-b89dafe8-d9eb-4c76-b3bd-e2c6f8cca0ee req-a9b5b01c-0430-4ed8-9f79-734579bb1198 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:23:58 user nova-compute[72426]: WARNING nova.compute.manager [req-b89dafe8-d9eb-4c76-b3bd-e2c6f8cca0ee req-a9b5b01c-0430-4ed8-9f79-734579bb1198 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state active and task_state None.
Aug 01 08:23:58 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878223.3704562, e1119088-18c7-483d-a89d-3b5d19054e52 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:23:58 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] VM Stopped (Lifecycle Event)
Aug 01 08:23:58 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4b7bb5db-bc11-447f-a7f8-cfa4753e1eec None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:23:58 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4b7bb5db-bc11-447f-a7f8-cfa4753e1eec None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:00 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:00 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "2572e472-73fe-4e5a-b486-e38274a978d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:03 user nova-compute[72426]: INFO nova.compute.manager [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Terminating instance
Aug 01 08:24:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:24:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-8b79fcf7-5c30-4f1c-9bb4-5f86431e2856 req-b342e06a-8825-4bb3-968d-82d8e4602c9f service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-vif-unplugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8b79fcf7-5c30-4f1c-9bb4-5f86431e2856 req-b342e06a-8825-4bb3-968d-82d8e4602c9f service nova] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8b79fcf7-5c30-4f1c-9bb4-5f86431e2856 req-b342e06a-8825-4bb3-968d-82d8e4602c9f service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8b79fcf7-5c30-4f1c-9bb4-5f86431e2856 req-b342e06a-8825-4bb3-968d-82d8e4602c9f service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-8b79fcf7-5c30-4f1c-9bb4-5f86431e2856 req-b342e06a-8825-4bb3-968d-82d8e4602c9f service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] No waiting events found dispatching network-vif-unplugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-8b79fcf7-5c30-4f1c-9bb4-5f86431e2856 req-b342e06a-8825-4bb3-968d-82d8e4602c9f service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-vif-unplugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:24:04 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Instance destroyed successfully.
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.objects.instance [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'resources' on Instance uuid 2572e472-73fe-4e5a-b486-e38274a978d7 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2008460603',display_name='tempest-ServerActionsTestOtherA-server-2008460603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2008460603',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-fivwx9jg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:21:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=2572e472-73fe-4e5a-b486-e38274a978d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "address": "fa:16:3e:00:51:b6", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f7d2fe1-5b", "ovs_interfaceid": "4f7d2fe1-5bf7-4270-a15a-11c145726e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_vif [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f7d2fe1-5b, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:04 user nova-compute[72426]: INFO os_vif [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=4f7d2fe1-5bf7-4270-a15a-11c145726e16,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f7d2fe1-5b')
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUPEtQHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:24:04 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59792be-445b-48f3-9033-e3b6e7477361]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c47843-4ae4-4bf9-bd33-a01491b11467]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:24:04 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:24:04 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:24:04 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:24:04 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:24:04 user nova-compute[72426]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a (non-flash)
Aug 01 08:24:04 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:24:04 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:24:04 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38a20550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a'): ({'sde'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Removing single pathed devices sde {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e9fab5-fd8b-4584-9dfe-1a33163450d8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24a96a3-9d43-4325-9239-a8d316e9bee8]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Flushing IO for device /dev/sde {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.050s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff68634-a8d7-46f2-a201-dd102280fe65]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.070s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeca67f-e2d8-4189-ab06-829ddd317c71]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] SCSI volumes sde have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.104s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fc5f1b-885d-4199-93be-81010c2703fe]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d6cf80-b4d2-46b6-a3bf-481c49909329]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260]
Aug 01 08:24:04 user nova-compute[72426]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a, portal: 172.16.0.220,3260] successful.
Aug 01 08:24:04 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ba8f463-9a40-4627-bb28-92ef381bde3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa7c4ef-890c-4ac2-b934-89e2707b6153]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.500s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] <== disconnect_volume: return (501ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:24:04 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Deleting instance files /opt/stack/data/nova/instances/2572e472-73fe-4e5a-b486-e38274a978d7_del
Aug 01 08:24:04 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Deletion of /opt/stack/data/nova/instances/2572e472-73fe-4e5a-b486-e38274a978d7_del complete
Aug 01 08:24:04 user nova-compute[72426]: INFO nova.compute.manager [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Took 1.46 seconds to destroy the instance on the hypervisor.
Aug 01 08:24:04 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:24:04 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:24:05 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:05 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Took 1.07 seconds to deallocate network for instance.
Aug 01 08:24:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-983ba341-29b5-4340-b6d3-2dd53f994ff1 req-bacae4c9-524d-42be-9ca9-023cbb4060b6 service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-vif-deleted-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-7a0eeb2b-abc9-435e-95e7-7854681bbfed req-ce190be3-0bec-4c6e-a90b-40b92107953a service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7a0eeb2b-abc9-435e-95e7-7854681bbfed req-ce190be3-0bec-4c6e-a90b-40b92107953a service nova] Acquiring lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7a0eeb2b-abc9-435e-95e7-7854681bbfed req-ce190be3-0bec-4c6e-a90b-40b92107953a service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7a0eeb2b-abc9-435e-95e7-7854681bbfed req-ce190be3-0bec-4c6e-a90b-40b92107953a service nova] Lock "2572e472-73fe-4e5a-b486-e38274a978d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-7a0eeb2b-abc9-435e-95e7-7854681bbfed req-ce190be3-0bec-4c6e-a90b-40b92107953a service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] No waiting events found dispatching network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:06 user nova-compute[72426]: WARNING nova.compute.manager [req-7a0eeb2b-abc9-435e-95e7-7854681bbfed req-ce190be3-0bec-4c6e-a90b-40b92107953a service nova] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Received unexpected event network-vif-plugged-4f7d2fe1-5bf7-4270-a15a-11c145726e16 for instance with vm_state active and task_state deleting.
Aug 01 08:24:06 user nova-compute[72426]: INFO nova.compute.manager [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Took 0.83 seconds to detach 1 volumes for instance.
Aug 01 08:24:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Deleting volume: 1ba8f463-9a40-4627-bb28-92ef381bde3a {{(pid=72426) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 08:24:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:07 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:24:07 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:24:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.499s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:07 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Deleted allocations for instance 2572e472-73fe-4e5a-b486-e38274a978d7
Aug 01 08:24:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-79e8970c-7dd9-488b-a84c-2e8b0bbce30f tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "2572e472-73fe-4e5a-b486-e38274a978d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.141s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-a154f21e-0287-4172-a190-eed0ee4d1a1a req-8f2003ce-f95b-42b9-b87c-f94258af38ec service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-changed-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-a154f21e-0287-4172-a190-eed0ee4d1a1a req-8f2003ce-f95b-42b9-b87c-f94258af38ec service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Refreshing instance network info cache due to event network-changed-068c4e66-773c-4192-ab91-664b48a5fe9e. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a154f21e-0287-4172-a190-eed0ee4d1a1a req-8f2003ce-f95b-42b9-b87c-f94258af38ec service nova] Acquiring lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a154f21e-0287-4172-a190-eed0ee4d1a1a req-8f2003ce-f95b-42b9-b87c-f94258af38ec service nova] Acquired lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG nova.network.neutron [req-a154f21e-0287-4172-a190-eed0ee4d1a1a req-8f2003ce-f95b-42b9-b87c-f94258af38ec service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Refreshing network info cache for port 068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'flavor' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:10 user nova-compute[72426]: INFO nova.compute.manager [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Attaching volume 79af08fc-5c5e-40c6-b57b-c1014b2d2b32 to /dev/vdb
Aug 01 08:24:10 user nova-compute[72426]: DEBUG nova.network.neutron [req-a154f21e-0287-4172-a190-eed0ee4d1a1a req-8f2003ce-f95b-42b9-b87c-f94258af38ec service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updated VIF entry in instance network info cache for port 068c4e66-773c-4192-ab91-664b48a5fe9e. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG nova.network.neutron [req-a154f21e-0287-4172-a190-eed0ee4d1a1a req-8f2003ce-f95b-42b9-b87c-f94258af38ec service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating instance_info_cache with network_info: [{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a154f21e-0287-4172-a190-eed0ee4d1a1a req-8f2003ce-f95b-42b9-b87c-f94258af38ec service nova] Releasing lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG os_brick.utils [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0864bb30-ef9f-4b87-a5c1-b01c005bc12d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ea65b5-bafe-4c3f-ba94-eb873d664aa4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea30241b-1865-423a-abd6-fac7df0c5800]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a02521b-7cf8-4e8b-a9e0-fac941e44c09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:24:10 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:24:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:24:11 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:24:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ebfdb3-ad40-4b55-8a2d-235aeb736a38]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:24:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:24:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:24:11 user nova-compute[72426]: DEBUG os_brick.utils [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:24:11 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating existing volume attachment record: 2f5a6cb4-c790-4617-b22a-fefaf67633af {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:24:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "468edb40-0972-4589-9395-826c1eeb0dc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:24:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:24:13 user nova-compute[72426]: INFO nova.compute.claims [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Claim successful on node user
Aug 01 08:24:13 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG nova.network.neutron [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:24:13 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:24:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG nova.policy [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f32fed5c40f24c2086d59cbb61f93bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4cff1bbd5247afa9ed2ddf4db11738', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:24:13 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Creating image(s)
Aug 01 08:24:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "/opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "/opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "/opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:13 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.190s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.162s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk 1073741824" returned: 0 in 0.068s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.168s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Cannot resize image /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG nova.objects.instance [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'migration_context' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Ensure instance console log exists: /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG nova.network.neutron [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Successfully created port: f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:24:14 user nova-compute[72426]: INFO nova.compute.claims [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Claim successful on node user
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:24:15 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.policy [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db1631e91f1462c9a1433fc10eba8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9859557c06bf4d50937390421acca14f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Successfully updated port: f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:24:15 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Creating image(s)
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "/opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "/opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquired lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.compute.manager [req-c6ee6622-5546-4165-9edc-4c2af3a39692 req-ddd52475-1419-44a8-87a5-e02bdd48bc3c service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-changed-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.compute.manager [req-c6ee6622-5546-4165-9edc-4c2af3a39692 req-ddd52475-1419-44a8-87a5-e02bdd48bc3c service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Refreshing instance network info cache due to event network-changed-f2a59028-82a7-4744-82f8-b9b0ec197596. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c6ee6622-5546-4165-9edc-4c2af3a39692 req-ddd52475-1419-44a8-87a5-e02bdd48bc3c service nova] Acquiring lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.160s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk 1073741824" returned: 0 in 0.054s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Cannot resize image /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lazy-loading 'migration_context' on Instance uuid 8fff7c8e-8129-40f3-ac3b-9b60408705ac {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Ensure instance console log exists: /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.network.neutron [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updating instance_info_cache with network_info: [{"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Releasing lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.compute.manager [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Instance network_info: |[{"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c6ee6622-5546-4165-9edc-4c2af3a39692 req-ddd52475-1419-44a8-87a5-e02bdd48bc3c service nova] Acquired lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.network.neutron [req-c6ee6622-5546-4165-9edc-4c2af3a39692 req-ddd52475-1419-44a8-87a5-e02bdd48bc3c service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Refreshing network info cache for port f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Start _get_guest_xml network_info=[{"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:24:16 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:24:16 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-346930247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-346930247',id=36,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOGJcD/bVQDB9UNIgYrZutvKusV64+EQs5MwRC0T3lUQ7Jba0bJ64Nnjdplr37shpC+G0dU9qi9dzjyF5eRM5Lpu8dfSmVg0g6OpDbBLWTgKqBw3s/M6sdjqtKs5hOYow==',key_name='tempest-keypair-1856498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-08m57t5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:24:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=468edb40-0972-4589-9395-826c1eeb0dc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.objects.instance [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'pci_devices' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:24:16 user nova-compute[72426]:   <uuid>468edb40-0972-4589-9395-826c1eeb0dc6</uuid>
Aug 01 08:24:16 user nova-compute[72426]:   <name>instance-00000024</name>
Aug 01 08:24:16 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:24:16 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:24:16 user nova-compute[72426]:   <metadata>
Aug 01 08:24:16 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:24:16 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:24:16 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-346930247</nova:name>
Aug 01 08:24:16 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:24:16</nova:creationTime>
Aug 01 08:24:16 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:24:16 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:24:16 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:24:16 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:24:16 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:24:16 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:24:16 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:24:16 user nova-compute[72426]:       <nova:owner>
Aug 01 08:24:16 user nova-compute[72426]:         <nova:user uuid="f32fed5c40f24c2086d59cbb61f93bea">tempest-AttachVolumeShelveTestJSON-1854691353-project-member</nova:user>
Aug 01 08:24:16 user nova-compute[72426]:         <nova:project uuid="9a4cff1bbd5247afa9ed2ddf4db11738">tempest-AttachVolumeShelveTestJSON-1854691353</nova:project>
Aug 01 08:24:16 user nova-compute[72426]:       </nova:owner>
Aug 01 08:24:16 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:24:16 user nova-compute[72426]:       <nova:ports>
Aug 01 08:24:16 user nova-compute[72426]:         <nova:port uuid="f2a59028-82a7-4744-82f8-b9b0ec197596">
Aug 01 08:24:16 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 08:24:16 user nova-compute[72426]:         </nova:port>
Aug 01 08:24:16 user nova-compute[72426]:       </nova:ports>
Aug 01 08:24:16 user nova-compute[72426]:     </nova:instance>
Aug 01 08:24:16 user nova-compute[72426]:   </metadata>
Aug 01 08:24:16 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:24:16 user nova-compute[72426]:     <system>
Aug 01 08:24:16 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:24:16 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:24:16 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:24:16 user nova-compute[72426]:       <entry name="serial">468edb40-0972-4589-9395-826c1eeb0dc6</entry>
Aug 01 08:24:16 user nova-compute[72426]:       <entry name="uuid">468edb40-0972-4589-9395-826c1eeb0dc6</entry>
Aug 01 08:24:16 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:24:16 user nova-compute[72426]:     </system>
Aug 01 08:24:16 user nova-compute[72426]:   </sysinfo>
Aug 01 08:24:16 user nova-compute[72426]:   <os>
Aug 01 08:24:16 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:24:16 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:24:16 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:24:16 user nova-compute[72426]:   </os>
Aug 01 08:24:16 user nova-compute[72426]:   <features>
Aug 01 08:24:16 user nova-compute[72426]:     <acpi/>
Aug 01 08:24:16 user nova-compute[72426]:     <apic/>
Aug 01 08:24:16 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:24:16 user nova-compute[72426]:   </features>
Aug 01 08:24:16 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:24:16 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:24:16 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:24:16 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:24:16 user nova-compute[72426]:   </clock>
Aug 01 08:24:16 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:24:16 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:24:16 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:24:16 user nova-compute[72426]:   </cpu>
Aug 01 08:24:16 user nova-compute[72426]:   <devices>
Aug 01 08:24:16 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:24:16 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:24:16 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk"/>
Aug 01 08:24:16 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:24:16 user nova-compute[72426]:     </disk>
Aug 01 08:24:16 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:24:16 user nova-compute[72426]:       <mac address="fa:16:3e:52:24:c0"/>
Aug 01 08:24:16 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:24:16 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:24:16 user nova-compute[72426]:       <target dev="tapf2a59028-82"/>
Aug 01 08:24:16 user nova-compute[72426]:     </interface>
Aug 01 08:24:16 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:24:16 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/console.log" append="off"/>
Aug 01 08:24:16 user nova-compute[72426]:     </serial>
Aug 01 08:24:16 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:24:16 user nova-compute[72426]:     <video>
Aug 01 08:24:16 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:24:16 user nova-compute[72426]:     </video>
Aug 01 08:24:16 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:24:16 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:24:16 user nova-compute[72426]:     </rng>
Aug 01 08:24:16 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:24:16 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:24:16 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:24:16 user nova-compute[72426]:     </memballoon>
Aug 01 08:24:16 user nova-compute[72426]:   </devices>
Aug 01 08:24:16 user nova-compute[72426]: </domain>
Aug 01 08:24:16 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-346930247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-346930247',id=36,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOGJcD/bVQDB9UNIgYrZutvKusV64+EQs5MwRC0T3lUQ7Jba0bJ64Nnjdplr37shpC+G0dU9qi9dzjyF5eRM5Lpu8dfSmVg0g6OpDbBLWTgKqBw3s/M6sdjqtKs5hOYow==',key_name='tempest-keypair-1856498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-08m57t5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:24:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=468edb40-0972-4589-9395-826c1eeb0dc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG os_vif [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2a59028-82, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2a59028-82, col_values=(('external_ids', {'iface-id': 'f2a59028-82a7-4744-82f8-b9b0ec197596', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:24:c0', 'vm-uuid': '468edb40-0972-4589-9395-826c1eeb0dc6'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:16 user nova-compute[72426]: INFO os_vif [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82')
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] No VIF found with MAC fa:16:3e:52:24:c0, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:24:16 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Successfully created port: 5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG nova.network.neutron [req-c6ee6622-5546-4165-9edc-4c2af3a39692 req-ddd52475-1419-44a8-87a5-e02bdd48bc3c service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updated VIF entry in instance network info cache for port f2a59028-82a7-4744-82f8-b9b0ec197596. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG nova.network.neutron [req-c6ee6622-5546-4165-9edc-4c2af3a39692 req-ddd52475-1419-44a8-87a5-e02bdd48bc3c service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updating instance_info_cache with network_info: [{"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c6ee6622-5546-4165-9edc-4c2af3a39692 req-ddd52475-1419-44a8-87a5-e02bdd48bc3c service nova] Releasing lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Successfully updated port: 5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "refresh_cache-8fff7c8e-8129-40f3-ac3b-9b60408705ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquired lock "refresh_cache-8fff7c8e-8129-40f3-ac3b-9b60408705ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG nova.compute.manager [req-440f7a2b-cc63-470b-97eb-c71e4c2c317a req-e91e7cfe-9cd1-4015-99d9-0a5e0e88d143 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Received event network-changed-5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG nova.compute.manager [req-440f7a2b-cc63-470b-97eb-c71e4c2c317a req-e91e7cfe-9cd1-4015-99d9-0a5e0e88d143 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Refreshing instance network info cache due to event network-changed-5cad54db-906a-4055-8d25-6a1857cbf6d2. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-440f7a2b-cc63-470b-97eb-c71e4c2c317a req-e91e7cfe-9cd1-4015-99d9-0a5e0e88d143 service nova] Acquiring lock "refresh_cache-8fff7c8e-8129-40f3-ac3b-9b60408705ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:17 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.network.neutron [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Updating instance_info_cache with network_info: [{"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Releasing lock "refresh_cache-8fff7c8e-8129-40f3-ac3b-9b60408705ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Instance network_info: |[{"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-440f7a2b-cc63-470b-97eb-c71e4c2c317a req-e91e7cfe-9cd1-4015-99d9-0a5e0e88d143 service nova] Acquired lock "refresh_cache-8fff7c8e-8129-40f3-ac3b-9b60408705ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.network.neutron [req-440f7a2b-cc63-470b-97eb-c71e4c2c317a req-e91e7cfe-9cd1-4015-99d9-0a5e0e88d143 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Refreshing network info cache for port 5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Start _get_guest_xml network_info=[{"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:24:18 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:24:18 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2048416265',display_name='tempest-ServersNegativeTestJSON-server-2048416265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2048416265',id=37,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9859557c06bf4d50937390421acca14f',ramdisk_id='',reservation_id='r-x1y403o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-330621956',owner_user_name='tempest-ServersNegativeTestJSON-330621956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:24:15Z,user_data=None,user_id='6db1631e91f1462c9a1433fc10eba8bf',uuid=8fff7c8e-8129-40f3-ac3b-9b60408705ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converting VIF {"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=5cad54db-906a-4055-8d25-6a1857cbf6d2,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cad54db-90') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fff7c8e-8129-40f3-ac3b-9b60408705ac {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-90ec8e78-5d19-44d8-a498-ec6686f587d7 req-1519bf56-eaaf-4d2f-9c11-94e0d3b85d6d service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-90ec8e78-5d19-44d8-a498-ec6686f587d7 req-1519bf56-eaaf-4d2f-9c11-94e0d3b85d6d service nova] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-90ec8e78-5d19-44d8-a498-ec6686f587d7 req-1519bf56-eaaf-4d2f-9c11-94e0d3b85d6d service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-90ec8e78-5d19-44d8-a498-ec6686f587d7 req-1519bf56-eaaf-4d2f-9c11-94e0d3b85d6d service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-90ec8e78-5d19-44d8-a498-ec6686f587d7 req-1519bf56-eaaf-4d2f-9c11-94e0d3b85d6d service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] No waiting events found dispatching network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:18 user nova-compute[72426]: WARNING nova.compute.manager [req-90ec8e78-5d19-44d8-a498-ec6686f587d7 req-1519bf56-eaaf-4d2f-9c11-94e0d3b85d6d service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received unexpected event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 for instance with vm_state building and task_state spawning.
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:24:18 user nova-compute[72426]:   <uuid>8fff7c8e-8129-40f3-ac3b-9b60408705ac</uuid>
Aug 01 08:24:18 user nova-compute[72426]:   <name>instance-00000025</name>
Aug 01 08:24:18 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:24:18 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:24:18 user nova-compute[72426]:   <metadata>
Aug 01 08:24:18 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:24:18 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:24:18 user nova-compute[72426]:       <nova:name>tempest-ServersNegativeTestJSON-server-2048416265</nova:name>
Aug 01 08:24:18 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:24:18</nova:creationTime>
Aug 01 08:24:18 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:24:18 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:24:18 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:24:18 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:24:18 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:24:18 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:24:18 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:24:18 user nova-compute[72426]:       <nova:owner>
Aug 01 08:24:18 user nova-compute[72426]:         <nova:user uuid="6db1631e91f1462c9a1433fc10eba8bf">tempest-ServersNegativeTestJSON-330621956-project-member</nova:user>
Aug 01 08:24:18 user nova-compute[72426]:         <nova:project uuid="9859557c06bf4d50937390421acca14f">tempest-ServersNegativeTestJSON-330621956</nova:project>
Aug 01 08:24:18 user nova-compute[72426]:       </nova:owner>
Aug 01 08:24:18 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:24:18 user nova-compute[72426]:       <nova:ports>
Aug 01 08:24:18 user nova-compute[72426]:         <nova:port uuid="5cad54db-906a-4055-8d25-6a1857cbf6d2">
Aug 01 08:24:18 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 08:24:18 user nova-compute[72426]:         </nova:port>
Aug 01 08:24:18 user nova-compute[72426]:       </nova:ports>
Aug 01 08:24:18 user nova-compute[72426]:     </nova:instance>
Aug 01 08:24:18 user nova-compute[72426]:   </metadata>
Aug 01 08:24:18 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:24:18 user nova-compute[72426]:     <system>
Aug 01 08:24:18 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:24:18 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:24:18 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:24:18 user nova-compute[72426]:       <entry name="serial">8fff7c8e-8129-40f3-ac3b-9b60408705ac</entry>
Aug 01 08:24:18 user nova-compute[72426]:       <entry name="uuid">8fff7c8e-8129-40f3-ac3b-9b60408705ac</entry>
Aug 01 08:24:18 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:24:18 user nova-compute[72426]:     </system>
Aug 01 08:24:18 user nova-compute[72426]:   </sysinfo>
Aug 01 08:24:18 user nova-compute[72426]:   <os>
Aug 01 08:24:18 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:24:18 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:24:18 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:24:18 user nova-compute[72426]:   </os>
Aug 01 08:24:18 user nova-compute[72426]:   <features>
Aug 01 08:24:18 user nova-compute[72426]:     <acpi/>
Aug 01 08:24:18 user nova-compute[72426]:     <apic/>
Aug 01 08:24:18 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:24:18 user nova-compute[72426]:   </features>
Aug 01 08:24:18 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:24:18 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:24:18 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:24:18 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:24:18 user nova-compute[72426]:   </clock>
Aug 01 08:24:18 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:24:18 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:24:18 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:24:18 user nova-compute[72426]:   </cpu>
Aug 01 08:24:18 user nova-compute[72426]:   <devices>
Aug 01 08:24:18 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:24:18 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:24:18 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk"/>
Aug 01 08:24:18 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:24:18 user nova-compute[72426]:     </disk>
Aug 01 08:24:18 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:24:18 user nova-compute[72426]:       <mac address="fa:16:3e:1f:2d:65"/>
Aug 01 08:24:18 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:24:18 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:24:18 user nova-compute[72426]:       <target dev="tap5cad54db-90"/>
Aug 01 08:24:18 user nova-compute[72426]:     </interface>
Aug 01 08:24:18 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:24:18 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/console.log" append="off"/>
Aug 01 08:24:18 user nova-compute[72426]:     </serial>
Aug 01 08:24:18 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:24:18 user nova-compute[72426]:     <video>
Aug 01 08:24:18 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:24:18 user nova-compute[72426]:     </video>
Aug 01 08:24:18 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:24:18 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:24:18 user nova-compute[72426]:     </rng>
Aug 01 08:24:18 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:24:18 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:24:18 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:24:18 user nova-compute[72426]:     </memballoon>
Aug 01 08:24:18 user nova-compute[72426]:   </devices>
Aug 01 08:24:18 user nova-compute[72426]: </domain>
Aug 01 08:24:18 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2048416265',display_name='tempest-ServersNegativeTestJSON-server-2048416265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2048416265',id=37,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9859557c06bf4d50937390421acca14f',ramdisk_id='',reservation_id='r-x1y403o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-330621956',owner_user_name='tempest-ServersNegativeTestJSON-330621956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:24:15Z,user_data=None,user_id='6db1631e91f1462c9a1433fc10eba8bf',uuid=8fff7c8e-8129-40f3-ac3b-9b60408705ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converting VIF {"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=5cad54db-906a-4055-8d25-6a1857cbf6d2,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cad54db-90') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG os_vif [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=5cad54db-906a-4055-8d25-6a1857cbf6d2,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cad54db-90') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cad54db-90, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5cad54db-90, col_values=(('external_ids', {'iface-id': '5cad54db-906a-4055-8d25-6a1857cbf6d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:2d:65', 'vm-uuid': '8fff7c8e-8129-40f3-ac3b-9b60408705ac'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: INFO os_vif [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=5cad54db-906a-4055-8d25-6a1857cbf6d2,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cad54db-90')
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] No VIF found with MAC fa:16:3e:1f:2d:65, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.network.neutron [req-440f7a2b-cc63-470b-97eb-c71e4c2c317a req-e91e7cfe-9cd1-4015-99d9-0a5e0e88d143 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Updated VIF entry in instance network info cache for port 5cad54db-906a-4055-8d25-6a1857cbf6d2. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG nova.network.neutron [req-440f7a2b-cc63-470b-97eb-c71e4c2c317a req-e91e7cfe-9cd1-4015-99d9-0a5e0e88d143 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Updating instance_info_cache with network_info: [{"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-440f7a2b-cc63-470b-97eb-c71e4c2c317a req-e91e7cfe-9cd1-4015-99d9-0a5e0e88d143 service nova] Releasing lock "refresh_cache-8fff7c8e-8129-40f3-ac3b-9b60408705ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rARPWiwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:24:19 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:24:19 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:24:19 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a76daf-edb8-4b61-b438-4c6a0c4a85af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:24:19 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[558efd2f-2582-46c9-84c0-5fdc4c894eeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32] added
Aug 01 08:24:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf4d8f-9e83-476e-b1cc-dbf50e180129]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[555bb503-1aa6-4627-aa9f-2cce2bc17516]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rARPWiwp {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rARPWiwp" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c054c431-94be-42db-a077-e22c464c9304]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rARPWiwp'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878244.2167714, 2572e472-73fe-4e5a-b486-e38274a978d7 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:19 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] VM Stopped (Lifecycle Event)
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[52000423-5075-48a5-a1d9-b574b4a84d38]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-83cc4ee9-9ac6-470d-ada9-fc1d55f80aa6 None None] [instance: 2572e472-73fe-4e5a-b486-e38274a978d7] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd19bba9-c483-4087-93d6-0c57c0077d28]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:24:19 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:24:19 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:24:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:24:19 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:24:19 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:24:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61c0c50-9663-4289-84a7-504f21fc1100]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32, portal: 172.16.0.220,3260]
Aug 01 08:24:19 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32, portal: 172.16.0.220,3260] successful.
Aug 01 08:24:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[389390e0-3a41-4413-815b-e1a4d8c96712]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3452d06-68ab-4366-be4a-4a6e78575ab9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:24:19 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:24:19 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:24:19 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:24:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:24:19 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:24:19 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:24:19 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:24:19 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5784280-12dc-4bd8-8825-a4886266f05a]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rARPWiwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-37fdb327-b80e-483e-a715-44f3a61292d2 req-16aacbed-4b3a-43f3-ae26-b10c7a62cf26 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Received event network-vif-plugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-37fdb327-b80e-483e-a715-44f3a61292d2 req-16aacbed-4b3a-43f3-ae26-b10c7a62cf26 service nova] Acquiring lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-37fdb327-b80e-483e-a715-44f3a61292d2 req-16aacbed-4b3a-43f3-ae26-b10c7a62cf26 service nova] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-37fdb327-b80e-483e-a715-44f3a61292d2 req-16aacbed-4b3a-43f3-ae26-b10c7a62cf26 service nova] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-37fdb327-b80e-483e-a715-44f3a61292d2 req-16aacbed-4b3a-43f3-ae26-b10c7a62cf26 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] No waiting events found dispatching network-vif-plugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:20 user nova-compute[72426]: WARNING nova.compute.manager [req-37fdb327-b80e-483e-a715-44f3a61292d2 req-16aacbed-4b3a-43f3-ae26-b10c7a62cf26 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Received unexpected event network-vif-plugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 for instance with vm_state building and task_state spawning.
Aug 01 08:24:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23439346531643734', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439346531643734', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'flavor' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-905d9d4a-5dc3-4c4e-8487-0bca2eaabb9e req-a8a0d47f-07c7-45e3-98fb-083caaab13c3 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-905d9d4a-5dc3-4c4e-8487-0bca2eaabb9e req-a8a0d47f-07c7-45e3-98fb-083caaab13c3 service nova] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-905d9d4a-5dc3-4c4e-8487-0bca2eaabb9e req-a8a0d47f-07c7-45e3-98fb-083caaab13c3 service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-905d9d4a-5dc3-4c4e-8487-0bca2eaabb9e req-a8a0d47f-07c7-45e3-98fb-083caaab13c3 service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG nova.compute.manager [req-905d9d4a-5dc3-4c4e-8487-0bca2eaabb9e req-a8a0d47f-07c7-45e3-98fb-083caaab13c3 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] No waiting events found dispatching network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:20 user nova-compute[72426]: WARNING nova.compute.manager [req-905d9d4a-5dc3-4c4e-8487-0bca2eaabb9e req-a8a0d47f-07c7-45e3-98fb-083caaab13c3 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received unexpected event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 for instance with vm_state building and task_state spawning.
Aug 01 08:24:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:24:20 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:24:20 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:24:20 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:24:20 user nova-compute[72426]:   <serial>79af08fc-5c5e-40c6-b57b-c1014b2d2b32</serial>
Aug 01 08:24:20 user nova-compute[72426]: </disk>
Aug 01 08:24:20 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No VIF found with MAC fa:16:3e:e4:cd:30, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:24:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cefde31c-77ae-4ae1-b2ee-ff1973c417d6 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.200s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878261.1929953, 468edb40-0972-4589-9395-826c1eeb0dc6 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:21 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] VM Resumed (Lifecycle Event)
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:24:21 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Instance spawned successfully.
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:21 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878261.1965225, 468edb40-0972-4589-9395-826c1eeb0dc6 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:21 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] VM Started (Lifecycle Event)
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:21 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:24:21 user nova-compute[72426]: INFO nova.compute.manager [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Took 7.45 seconds to spawn the instance on the hypervisor.
Aug 01 08:24:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:21 user nova-compute[72426]: INFO nova.compute.manager [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Took 8.47 seconds to build instance.
Aug 01 08:24:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-573b08f2-25f9-4a83-92d9-891d00df7788 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "468edb40-0972-4589-9395-826c1eeb0dc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.592s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878262.0056496, 8fff7c8e-8129-40f3-ac3b-9b60408705ac => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:22 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] VM Resumed (Lifecycle Event)
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:24:22 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Instance spawned successfully.
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:22 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878262.014432, 8fff7c8e-8129-40f3-ac3b-9b60408705ac => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:22 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] VM Started (Lifecycle Event)
Aug 01 08:24:22 user nova-compute[72426]: INFO nova.compute.manager [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Rescuing
Aug 01 08:24:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquired lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.network.neutron [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:22 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:24:22 user nova-compute[72426]: INFO nova.compute.manager [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Took 6.56 seconds to spawn the instance on the hypervisor.
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-a74d19b6-94c2-4b06-9d7a-71d6cc74213f req-89c48f2f-af2c-4ec8-a923-4a9317aff01f service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Received event network-vif-plugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a74d19b6-94c2-4b06-9d7a-71d6cc74213f req-89c48f2f-af2c-4ec8-a923-4a9317aff01f service nova] Acquiring lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a74d19b6-94c2-4b06-9d7a-71d6cc74213f req-89c48f2f-af2c-4ec8-a923-4a9317aff01f service nova] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a74d19b6-94c2-4b06-9d7a-71d6cc74213f req-89c48f2f-af2c-4ec8-a923-4a9317aff01f service nova] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-a74d19b6-94c2-4b06-9d7a-71d6cc74213f req-89c48f2f-af2c-4ec8-a923-4a9317aff01f service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] No waiting events found dispatching network-vif-plugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:22 user nova-compute[72426]: WARNING nova.compute.manager [req-a74d19b6-94c2-4b06-9d7a-71d6cc74213f req-89c48f2f-af2c-4ec8-a923-4a9317aff01f service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Received unexpected event network-vif-plugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 for instance with vm_state building and task_state spawning.
Aug 01 08:24:22 user nova-compute[72426]: INFO nova.compute.manager [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Took 7.49 seconds to build instance.
Aug 01 08:24:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f567e3f5-b3b8-4fce-b65e-f244253877aa tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.640s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.network.neutron [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating instance_info_cache with network_info: [{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Releasing lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-60beff6a-d646-4eb0-9240-37a75e6ec222 req-21911272-fe73-4110-b505-659071564e46 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-unplugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-60beff6a-d646-4eb0-9240-37a75e6ec222 req-21911272-fe73-4110-b505-659071564e46 service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-60beff6a-d646-4eb0-9240-37a75e6ec222 req-21911272-fe73-4110-b505-659071564e46 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-60beff6a-d646-4eb0-9240-37a75e6ec222 req-21911272-fe73-4110-b505-659071564e46 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:22 user nova-compute[72426]: DEBUG nova.compute.manager [req-60beff6a-d646-4eb0-9240-37a75e6ec222 req-21911272-fe73-4110-b505-659071564e46 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-unplugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:22 user nova-compute[72426]: WARNING nova.compute.manager [req-60beff6a-d646-4eb0-9240-37a75e6ec222 req-21911272-fe73-4110-b505-659071564e46 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-unplugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state active and task_state rescuing.
Aug 01 08:24:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Instance destroyed successfully.
Aug 01 08:24:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Attempting rescue
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72426) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Instance directory exists: not creating {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 08:24:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Creating image(s)
Aug 01 08:24:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'trusted_certs' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue" returned: 0 in 0.052s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'migration_context' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Start _get_guest_xml network_info=[{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "vif_mac": "fa:16:3e:e4:cd:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'resources' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'numa_topology' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:23 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:24:23 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'vcpu_model' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:22:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2113830838',display_name='tempest-ServerRescueNegativeTestJSON-server-2113830838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2113830838',id=34,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmtOi+bpc4SNJclltShPtVhZ2QLhLTJtvjPq0Y7w1K2KmdAkgHdbi/NZD+sFFRgCAHd0Mv5FbBE1+JKB4eeZ2wTuddjE5J4Z7huLigft3Un4MM8fMXHMUxilPaF6xAlCg==',key_name='tempest-keypair-1565746410',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-dsegwca3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e024ff90ae7148819d1d518d3754733f',uuid=c707f931-d77d-44c8-a352-49e673ff6c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "vif_mac": "fa:16:3e:e4:cd:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "vif_mac": "fa:16:3e:e4:cd:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cd:30,bridge_name='br-int',has_traffic_filtering=True,id=068c4e66-773c-4192-ab91-664b48a5fe9e,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c4e66-77') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'pci_devices' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:24:23 user nova-compute[72426]:   <uuid>c707f931-d77d-44c8-a352-49e673ff6c0b</uuid>
Aug 01 08:24:23 user nova-compute[72426]:   <name>instance-00000022</name>
Aug 01 08:24:23 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:24:23 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:24:23 user nova-compute[72426]:   <metadata>
Aug 01 08:24:23 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:24:23 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:24:23 user nova-compute[72426]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2113830838</nova:name>
Aug 01 08:24:23 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:24:23</nova:creationTime>
Aug 01 08:24:23 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:24:23 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:24:23 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:24:23 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:24:23 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:24:23 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:24:23 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:24:23 user nova-compute[72426]:       <nova:owner>
Aug 01 08:24:23 user nova-compute[72426]:         <nova:user uuid="e024ff90ae7148819d1d518d3754733f">tempest-ServerRescueNegativeTestJSON-1267015268-project-member</nova:user>
Aug 01 08:24:23 user nova-compute[72426]:         <nova:project uuid="ba9024541f804b259eeed3f2dd0ce12f">tempest-ServerRescueNegativeTestJSON-1267015268</nova:project>
Aug 01 08:24:23 user nova-compute[72426]:       </nova:owner>
Aug 01 08:24:23 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:24:23 user nova-compute[72426]:       <nova:ports>
Aug 01 08:24:23 user nova-compute[72426]:         <nova:port uuid="068c4e66-773c-4192-ab91-664b48a5fe9e">
Aug 01 08:24:23 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 08:24:23 user nova-compute[72426]:         </nova:port>
Aug 01 08:24:23 user nova-compute[72426]:       </nova:ports>
Aug 01 08:24:23 user nova-compute[72426]:     </nova:instance>
Aug 01 08:24:23 user nova-compute[72426]:   </metadata>
Aug 01 08:24:23 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:24:23 user nova-compute[72426]:     <system>
Aug 01 08:24:23 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:24:23 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:24:23 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:24:23 user nova-compute[72426]:       <entry name="serial">c707f931-d77d-44c8-a352-49e673ff6c0b</entry>
Aug 01 08:24:23 user nova-compute[72426]:       <entry name="uuid">c707f931-d77d-44c8-a352-49e673ff6c0b</entry>
Aug 01 08:24:23 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:24:23 user nova-compute[72426]:     </system>
Aug 01 08:24:23 user nova-compute[72426]:   </sysinfo>
Aug 01 08:24:23 user nova-compute[72426]:   <os>
Aug 01 08:24:23 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:24:23 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:24:23 user nova-compute[72426]:   </os>
Aug 01 08:24:23 user nova-compute[72426]:   <features>
Aug 01 08:24:23 user nova-compute[72426]:     <acpi/>
Aug 01 08:24:23 user nova-compute[72426]:     <apic/>
Aug 01 08:24:23 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:24:23 user nova-compute[72426]:   </features>
Aug 01 08:24:23 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:24:23 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:24:23 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:24:23 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:24:23 user nova-compute[72426]:   </clock>
Aug 01 08:24:23 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:24:23 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:24:23 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:24:23 user nova-compute[72426]:   </cpu>
Aug 01 08:24:23 user nova-compute[72426]:   <devices>
Aug 01 08:24:23 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:24:23 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:24:23 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue"/>
Aug 01 08:24:23 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:24:23 user nova-compute[72426]:     </disk>
Aug 01 08:24:23 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:24:23 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:24:23 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk"/>
Aug 01 08:24:23 user nova-compute[72426]:       <target dev="vdb" bus="virtio"/>
Aug 01 08:24:23 user nova-compute[72426]:     </disk>
Aug 01 08:24:23 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:24:23 user nova-compute[72426]:       <mac address="fa:16:3e:e4:cd:30"/>
Aug 01 08:24:23 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:24:23 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:24:23 user nova-compute[72426]:       <target dev="tap068c4e66-77"/>
Aug 01 08:24:23 user nova-compute[72426]:     </interface>
Aug 01 08:24:23 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:24:23 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/console.log" append="off"/>
Aug 01 08:24:23 user nova-compute[72426]:     </serial>
Aug 01 08:24:23 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:24:23 user nova-compute[72426]:     <video>
Aug 01 08:24:23 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:24:23 user nova-compute[72426]:     </video>
Aug 01 08:24:23 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:24:23 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:24:23 user nova-compute[72426]:     </rng>
Aug 01 08:24:23 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:24:23 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:24:23 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:24:23 user nova-compute[72426]:     </memballoon>
Aug 01 08:24:23 user nova-compute[72426]:   </devices>
Aug 01 08:24:23 user nova-compute[72426]: </domain>
Aug 01 08:24:23 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:24:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Instance destroyed successfully.
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:24:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] No VIF found with MAC fa:16:3e:e4:cd:30, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-2e065286-c5b0-4494-81a5-61d5260df575 req-df21f756-a3bd-4749-9e40-26b134af6963 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2e065286-c5b0-4494-81a5-61d5260df575 req-df21f756-a3bd-4749-9e40-26b134af6963 service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2e065286-c5b0-4494-81a5-61d5260df575 req-df21f756-a3bd-4749-9e40-26b134af6963 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2e065286-c5b0-4494-81a5-61d5260df575 req-df21f756-a3bd-4749-9e40-26b134af6963 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-2e065286-c5b0-4494-81a5-61d5260df575 req-df21f756-a3bd-4749-9e40-26b134af6963 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:25 user nova-compute[72426]: WARNING nova.compute.manager [req-2e065286-c5b0-4494-81a5-61d5260df575 req-df21f756-a3bd-4749-9e40-26b134af6963 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state active and task_state rescuing.
Aug 01 08:24:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:27 user nova-compute[72426]: WARNING nova.compute.manager [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state active and task_state rescuing.
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:27 user nova-compute[72426]: WARNING nova.compute.manager [req-9aa57f67-962b-4d64-b378-9a1b0c1466a1 req-41e54192-6953-45b1-b714-c466e1c01314 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state active and task_state rescuing.
Aug 01 08:24:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for c707f931-d77d-44c8-a352-49e673ff6c0b due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878267.6889305, c707f931-d77d-44c8-a352-49e673ff6c0b => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:27 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] VM Resumed (Lifecycle Event)
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.compute.manager [None req-e7083c3a-74cd-4458-a053-a5aac6488909 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:27 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878267.700414, c707f931-d77d-44c8-a352-49e673ff6c0b => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:27 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] VM Started (Lifecycle Event)
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:27 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:28 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:28 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:24:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:29 user nova-compute[72426]: INFO nova.compute.manager [None req-4aa580dd-65da-403b-9b9a-028673d1eef8 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Unrescuing
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4aa580dd-65da-403b-9b9a-028673d1eef8 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4aa580dd-65da-403b-9b9a-028673d1eef8 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquired lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4aa580dd-65da-403b-9b9a-028673d1eef8 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG nova.network.neutron [None req-4aa580dd-65da-403b-9b9a-028673d1eef8 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updating instance_info_cache with network_info: [{"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4aa580dd-65da-403b-9b9a-028673d1eef8 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Releasing lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG nova.objects.instance [None req-4aa580dd-65da-403b-9b9a-028673d1eef8 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'flavor' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG nova.compute.manager [req-3386a8dc-66b8-46b4-886a-7add41ed2c98 req-aeeb8bcc-e160-4578-90bc-6b4d0dbc4629 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-unplugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3386a8dc-66b8-46b4-886a-7add41ed2c98 req-aeeb8bcc-e160-4578-90bc-6b4d0dbc4629 service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3386a8dc-66b8-46b4-886a-7add41ed2c98 req-aeeb8bcc-e160-4578-90bc-6b4d0dbc4629 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3386a8dc-66b8-46b4-886a-7add41ed2c98 req-aeeb8bcc-e160-4578-90bc-6b4d0dbc4629 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG nova.compute.manager [req-3386a8dc-66b8-46b4-886a-7add41ed2c98 req-aeeb8bcc-e160-4578-90bc-6b4d0dbc4629 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-unplugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:31 user nova-compute[72426]: WARNING nova.compute.manager [req-3386a8dc-66b8-46b4-886a-7add41ed2c98 req-aeeb8bcc-e160-4578-90bc-6b4d0dbc4629 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-unplugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:31 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Instance destroyed successfully.
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-changed-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG nova.compute.manager [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Refreshing instance network info cache due to event network-changed-a87f8f30-667e-4321-9d19-04f12f45eb7f. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Acquiring lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Acquired lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG nova.network.neutron [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Refreshing network info cache for port a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for 05637642-f020-48af-b44a-d48e25a598fa due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878275.2875473, 05637642-f020-48af-b44a-d48e25a598fa => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:35 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] VM Resumed (Lifecycle Event)
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-bfffdd32-c680-4463-8265-d7cce358b4ea req-0f135763-f438-43c0-a8ac-9e6bbccf7a4b service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bfffdd32-c680-4463-8265-d7cce358b4ea req-0f135763-f438-43c0-a8ac-9e6bbccf7a4b service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bfffdd32-c680-4463-8265-d7cce358b4ea req-0f135763-f438-43c0-a8ac-9e6bbccf7a4b service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bfffdd32-c680-4463-8265-d7cce358b4ea req-0f135763-f438-43c0-a8ac-9e6bbccf7a4b service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-bfffdd32-c680-4463-8265-d7cce358b4ea req-0f135763-f438-43c0-a8ac-9e6bbccf7a4b service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:35 user nova-compute[72426]: WARNING nova.compute.manager [req-bfffdd32-c680-4463-8265-d7cce358b4ea req-0f135763-f438-43c0-a8ac-9e6bbccf7a4b service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4aa580dd-65da-403b-9b9a-028673d1eef8 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:35 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:24:35 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7111MB free_disk=25.047107696533203GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:35 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878275.2887423, 05637642-f020-48af-b44a-d48e25a598fa => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:35 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] VM Started (Lifecycle Event)
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updated VIF entry in instance network info cache for port a87f8f30-667e-4321-9d19-04f12f45eb7f. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updating instance_info_cache with network_info: [{"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Releasing lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-changed-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Refreshing instance network info cache due to event network-changed-a87f8f30-667e-4321-9d19-04f12f45eb7f. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Acquiring lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Acquired lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:35 user nova-compute[72426]: DEBUG nova.network.neutron [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Refreshing network info cache for port a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 73fb06b8-0824-42fc-bbfd-6914bdb78824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance e1119088-18c7-483d-a89d-3b5d19054e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 05637642-f020-48af-b44a-d48e25a598fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance b4d8cd69-296b-4253-badc-75e771af39b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 37dab412-5a15-46e8-844e-2ef0c03b7181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c707f931-d77d-44c8-a352-49e673ff6c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 468edb40-0972-4589-9395-826c1eeb0dc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 8fff7c8e-8129-40f3-ac3b-9b60408705ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.network.neutron [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updated VIF entry in instance network info cache for port a87f8f30-667e-4321-9d19-04f12f45eb7f. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.network.neutron [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updating instance_info_cache with network_info: [{"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Releasing lock "refresh_cache-05637642-f020-48af-b44a-d48e25a598fa" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:36 user nova-compute[72426]: WARNING nova.compute.manager [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:36 user nova-compute[72426]: WARNING nova.compute.manager [req-d9c79075-a98d-4722-bc0e-1649609cbc28 req-ff7ab986-d86c-4ea8-846a-f1ced5001190 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.805s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 08:24:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] There are 0 instances to clean {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 08:24:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:39 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:39 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:24:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updating instance_info_cache with network_info: [{"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72426) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 08:24:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:42 user nova-compute[72426]: INFO nova.compute.manager [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] instance snapshotting
Aug 01 08:24:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Beginning live snapshot process
Aug 01 08:24:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json -f qcow2 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json -f qcow2" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json -f qcow2 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9mmwszjd/b15af2dfa18d4e64815a5a12cb91e767.delta 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9mmwszjd/b15af2dfa18d4e64815a5a12cb91e767.delta 1073741824" returned: 0 in 0.175s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 08:24:44 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:24:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72426) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 08:24:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] COPY block job progress, current cursor: 25624576 final cursor: 75563008 {{(pid=72426) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 08:24:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72426) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 08:24:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 08:24:45 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:24:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9mmwszjd/b15af2dfa18d4e64815a5a12cb91e767.delta /opt/stack/data/nova/instances/snapshots/tmp9mmwszjd/b15af2dfa18d4e64815a5a12cb91e767 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9mmwszjd/b15af2dfa18d4e64815a5a12cb91e767.delta /opt/stack/data/nova/instances/snapshots/tmp9mmwszjd/b15af2dfa18d4e64815a5a12cb91e767" returned: 0 in 0.826s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Snapshot extracted, beginning image upload
Aug 01 08:24:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Snapshot image upload complete
Aug 01 08:24:49 user nova-compute[72426]: INFO nova.compute.manager [None req-4d90a74e-521d-4b6e-acb8-6fe7949726f0 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Took 6.42 seconds to snapshot the instance on the hypervisor.
Aug 01 08:24:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:51 user nova-compute[72426]: DEBUG nova.compute.manager [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:24:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:51 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:24:51 user nova-compute[72426]: INFO nova.compute.claims [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Claim successful on node user
Aug 01 08:24:52 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG nova.network.neutron [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:24:52 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:24:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG nova.policy [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56d58ffe9bad4d1fb35367ac0e60d181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff89c616cbd48e685d1d4330c874bb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:24:52 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Creating image(s)
Aug 01 08:24:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "/opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "/opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "0466c4b01d07113db1f88ba86a349640053f3e5a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "0466c4b01d07113db1f88ba86a349640053f3e5a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a.part --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:53 user nova-compute[72426]: DEBUG nova.network.neutron [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Successfully created port: 550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:24:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a.part --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:53 user nova-compute[72426]: DEBUG nova.virt.images [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] 38626285-d64a-4eec-a829-641ce39effcc was qcow2, converting to raw {{(pid=72426) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 08:24:53 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:24:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a.part /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a.converted {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a.part /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a.converted" returned: 0 in 0.647s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a.converted --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.network.neutron [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Successfully updated port: 550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "0466c4b01d07113db1f88ba86a349640053f3e5a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.987s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-cd71d980-5096-48e3-97e0-151171609d8c req-017c6fb0-d8e8-4e3f-8b89-db72446a2cad service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received event network-changed-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-cd71d980-5096-48e3-97e0-151171609d8c req-017c6fb0-d8e8-4e3f-8b89-db72446a2cad service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Refreshing instance network info cache due to event network-changed-550346c3-b6a2-4aec-a520-93f161d77018. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cd71d980-5096-48e3-97e0-151171609d8c req-017c6fb0-d8e8-4e3f-8b89-db72446a2cad service nova] Acquiring lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cd71d980-5096-48e3-97e0-151171609d8c req-017c6fb0-d8e8-4e3f-8b89-db72446a2cad service nova] Acquired lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.network.neutron [req-cd71d980-5096-48e3-97e0-151171609d8c req-017c6fb0-d8e8-4e3f-8b89-db72446a2cad service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Refreshing network info cache for port 550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.network.neutron [req-cd71d980-5096-48e3-97e0-151171609d8c req-017c6fb0-d8e8-4e3f-8b89-db72446a2cad service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "0466c4b01d07113db1f88ba86a349640053f3e5a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "0466c4b01d07113db1f88ba86a349640053f3e5a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a,backing_fmt=raw /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.network.neutron [req-cd71d980-5096-48e3-97e0-151171609d8c req-017c6fb0-d8e8-4e3f-8b89-db72446a2cad service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a,backing_fmt=raw /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk 1073741824" returned: 0 in 0.051s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "0466c4b01d07113db1f88ba86a349640053f3e5a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cd71d980-5096-48e3-97e0-151171609d8c req-017c6fb0-d8e8-4e3f-8b89-db72446a2cad service nova] Releasing lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquired lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.network.neutron [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.network.neutron [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0466c4b01d07113db1f88ba86a349640053f3e5a --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.objects.instance [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'migration_context' on Instance uuid 1fc3bc29-8fc0-41ee-b54c-90d960996c41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Ensure instance console log exists: /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.network.neutron [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Updating instance_info_cache with network_info: [{"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Releasing lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.compute.manager [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Instance network_info: |[{"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Start _get_guest_xml network_info=[{"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5a88af7bcc9a158e050fe8ffc55abc9c',container_format='bare',created_at=2023-08-01T08:24:43Z,direct_url=<?>,disk_format='qcow2',id=38626285-d64a-4eec-a829-641ce39effcc,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-934519102',owner='1ff89c616cbd48e685d1d4330c874bb7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T08:24:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '38626285-d64a-4eec-a829-641ce39effcc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:24:55 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:24:55 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5a88af7bcc9a158e050fe8ffc55abc9c',container_format='bare',created_at=2023-08-01T08:24:43Z,direct_url=<?>,disk_format='qcow2',id=38626285-d64a-4eec-a829-641ce39effcc,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-934519102',owner='1ff89c616cbd48e685d1d4330c874bb7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T08:24:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-397800128',display_name='tempest-TestStampPattern-server-397800128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-397800128',id=38,image_ref='38626285-d64a-4eec-a829-641ce39effcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzi07fWEZm9ZDpMiwLaYbjLSFJSACGngqPGH6IXGkKdZqaHEkFII80iFN525qE1V6pVTrPP41DJXrIqlOvHoD2AT4HCLJUUwmYLnWGEElwg4L0QUNN1qgp0PiMSAfYWeA==',key_name='tempest-TestStampPattern-721892585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ff89c616cbd48e685d1d4330c874bb7',ramdisk_id='',reservation_id='r-oocvb6wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='37dab412-5a15-46e8-844e-2ef0c03b7181',image_min_disk='1',image_min_ram='0',image_owner_id='1ff89c616cbd48e685d1d4330c874bb7',image_owner_project_name='tempest-TestStampPattern-936652585',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-936652585-project-member',image_user_id='56d58ffe9bad4d1fb35367ac0e60d181',network_allocated='True',owner_project_name='tempest-TestStampPattern-936652585',owner_user_name='tempest-TestStampPattern-936652585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:24:52Z,user_data=None,user_id='56d58ffe9bad4d1fb35367ac0e60d181',uuid=1fc3bc29-8fc0-41ee-b54c-90d960996c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converting VIF {"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:0b:8b,bridge_name='br-int',has_traffic_filtering=True,id=550346c3-b6a2-4aec-a520-93f161d77018,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550346c3-b6') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.objects.instance [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fc3bc29-8fc0-41ee-b54c-90d960996c41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:24:55 user nova-compute[72426]:   <uuid>1fc3bc29-8fc0-41ee-b54c-90d960996c41</uuid>
Aug 01 08:24:55 user nova-compute[72426]:   <name>instance-00000026</name>
Aug 01 08:24:55 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:24:55 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:24:55 user nova-compute[72426]:   <metadata>
Aug 01 08:24:55 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:24:55 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:24:55 user nova-compute[72426]:       <nova:name>tempest-TestStampPattern-server-397800128</nova:name>
Aug 01 08:24:55 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:24:55</nova:creationTime>
Aug 01 08:24:55 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:24:55 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:24:55 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:24:55 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:24:55 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:24:55 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:24:55 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:24:55 user nova-compute[72426]:       <nova:owner>
Aug 01 08:24:55 user nova-compute[72426]:         <nova:user uuid="56d58ffe9bad4d1fb35367ac0e60d181">tempest-TestStampPattern-936652585-project-member</nova:user>
Aug 01 08:24:55 user nova-compute[72426]:         <nova:project uuid="1ff89c616cbd48e685d1d4330c874bb7">tempest-TestStampPattern-936652585</nova:project>
Aug 01 08:24:55 user nova-compute[72426]:       </nova:owner>
Aug 01 08:24:55 user nova-compute[72426]:       <nova:root type="image" uuid="38626285-d64a-4eec-a829-641ce39effcc"/>
Aug 01 08:24:55 user nova-compute[72426]:       <nova:ports>
Aug 01 08:24:55 user nova-compute[72426]:         <nova:port uuid="550346c3-b6a2-4aec-a520-93f161d77018">
Aug 01 08:24:55 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 08:24:55 user nova-compute[72426]:         </nova:port>
Aug 01 08:24:55 user nova-compute[72426]:       </nova:ports>
Aug 01 08:24:55 user nova-compute[72426]:     </nova:instance>
Aug 01 08:24:55 user nova-compute[72426]:   </metadata>
Aug 01 08:24:55 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:24:55 user nova-compute[72426]:     <system>
Aug 01 08:24:55 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:24:55 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:24:55 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:24:55 user nova-compute[72426]:       <entry name="serial">1fc3bc29-8fc0-41ee-b54c-90d960996c41</entry>
Aug 01 08:24:55 user nova-compute[72426]:       <entry name="uuid">1fc3bc29-8fc0-41ee-b54c-90d960996c41</entry>
Aug 01 08:24:55 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:24:55 user nova-compute[72426]:     </system>
Aug 01 08:24:55 user nova-compute[72426]:   </sysinfo>
Aug 01 08:24:55 user nova-compute[72426]:   <os>
Aug 01 08:24:55 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:24:55 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:24:55 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:24:55 user nova-compute[72426]:   </os>
Aug 01 08:24:55 user nova-compute[72426]:   <features>
Aug 01 08:24:55 user nova-compute[72426]:     <acpi/>
Aug 01 08:24:55 user nova-compute[72426]:     <apic/>
Aug 01 08:24:55 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:24:55 user nova-compute[72426]:   </features>
Aug 01 08:24:55 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:24:55 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:24:55 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:24:55 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:24:55 user nova-compute[72426]:   </clock>
Aug 01 08:24:55 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:24:55 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:24:55 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:24:55 user nova-compute[72426]:   </cpu>
Aug 01 08:24:55 user nova-compute[72426]:   <devices>
Aug 01 08:24:55 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:24:55 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:24:55 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk"/>
Aug 01 08:24:55 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:24:55 user nova-compute[72426]:     </disk>
Aug 01 08:24:55 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:24:55 user nova-compute[72426]:       <mac address="fa:16:3e:d7:0b:8b"/>
Aug 01 08:24:55 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:24:55 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:24:55 user nova-compute[72426]:       <target dev="tap550346c3-b6"/>
Aug 01 08:24:55 user nova-compute[72426]:     </interface>
Aug 01 08:24:55 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:24:55 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/console.log" append="off"/>
Aug 01 08:24:55 user nova-compute[72426]:     </serial>
Aug 01 08:24:55 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:24:55 user nova-compute[72426]:     <video>
Aug 01 08:24:55 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:24:55 user nova-compute[72426]:     </video>
Aug 01 08:24:55 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:24:55 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:24:55 user nova-compute[72426]:     </rng>
Aug 01 08:24:55 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:24:55 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:24:55 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:24:55 user nova-compute[72426]:     </memballoon>
Aug 01 08:24:55 user nova-compute[72426]:   </devices>
Aug 01 08:24:55 user nova-compute[72426]: </domain>
Aug 01 08:24:55 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-397800128',display_name='tempest-TestStampPattern-server-397800128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-397800128',id=38,image_ref='38626285-d64a-4eec-a829-641ce39effcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzi07fWEZm9ZDpMiwLaYbjLSFJSACGngqPGH6IXGkKdZqaHEkFII80iFN525qE1V6pVTrPP41DJXrIqlOvHoD2AT4HCLJUUwmYLnWGEElwg4L0QUNN1qgp0PiMSAfYWeA==',key_name='tempest-TestStampPattern-721892585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ff89c616cbd48e685d1d4330c874bb7',ramdisk_id='',reservation_id='r-oocvb6wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='37dab412-5a15-46e8-844e-2ef0c03b7181',image_min_disk='1',image_min_ram='0',image_owner_id='1ff89c616cbd48e685d1d4330c874bb7',image_owner_project_name='tempest-TestStampPattern-936652585',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-936652585-project-member',image_user_id='56d58ffe9bad4d1fb35367ac0e60d181',network_allocated='True',owner_project_name='tempest-TestStampPattern-936652585',owner_user_name='tempest-TestStampPattern-936652585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:24:52Z,user_data=None,user_id='56d58ffe9bad4d1fb35367ac0e60d181',uuid=1fc3bc29-8fc0-41ee-b54c-90d960996c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converting VIF {"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:0b:8b,bridge_name='br-int',has_traffic_filtering=True,id=550346c3-b6a2-4aec-a520-93f161d77018,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550346c3-b6') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG os_vif [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:0b:8b,bridge_name='br-int',has_traffic_filtering=True,id=550346c3-b6a2-4aec-a520-93f161d77018,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550346c3-b6') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap550346c3-b6, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap550346c3-b6, col_values=(('external_ids', {'iface-id': '550346c3-b6a2-4aec-a520-93f161d77018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:0b:8b', 'vm-uuid': '1fc3bc29-8fc0-41ee-b54c-90d960996c41'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:55 user nova-compute[72426]: INFO os_vif [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:0b:8b,bridge_name='br-int',has_traffic_filtering=True,id=550346c3-b6a2-4aec-a520-93f161d77018,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550346c3-b6')
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:24:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] No VIF found with MAC fa:16:3e:d7:0b:8b, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:24:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-88ed2ad9-4365-4233-8f1e-70ad7f2ac3fb req-3fb0b1f5-33fa-4602-83f5-ff50bb8c4d3b service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received event network-vif-plugged-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-88ed2ad9-4365-4233-8f1e-70ad7f2ac3fb req-3fb0b1f5-33fa-4602-83f5-ff50bb8c4d3b service nova] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-88ed2ad9-4365-4233-8f1e-70ad7f2ac3fb req-3fb0b1f5-33fa-4602-83f5-ff50bb8c4d3b service nova] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-88ed2ad9-4365-4233-8f1e-70ad7f2ac3fb req-3fb0b1f5-33fa-4602-83f5-ff50bb8c4d3b service nova] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-88ed2ad9-4365-4233-8f1e-70ad7f2ac3fb req-3fb0b1f5-33fa-4602-83f5-ff50bb8c4d3b service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] No waiting events found dispatching network-vif-plugged-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:56 user nova-compute[72426]: WARNING nova.compute.manager [req-88ed2ad9-4365-4233-8f1e-70ad7f2ac3fb req-3fb0b1f5-33fa-4602-83f5-ff50bb8c4d3b service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received unexpected event network-vif-plugged-550346c3-b6a2-4aec-a520-93f161d77018 for instance with vm_state building and task_state spawning.
Aug 01 08:24:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:58 user nova-compute[72426]: INFO nova.compute.manager [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Terminating instance
Aug 01 08:24:58 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878298.944124, 1fc3bc29-8fc0-41ee-b54c-90d960996c41 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:58 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] VM Resumed (Lifecycle Event)
Aug 01 08:24:58 user nova-compute[72426]: DEBUG nova.compute.manager [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:24:58 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Instance spawned successfully.
Aug 01 08:24:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:58 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:59 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878298.9467068, 1fc3bc29-8fc0-41ee-b54c-90d960996c41 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:24:59 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] VM Started (Lifecycle Event)
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-42128592-f882-47b4-b112-e500c1a46f75 req-d21b5d53-a806-4c0f-874e-a2db3ff5f593 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received event network-vif-plugged-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-42128592-f882-47b4-b112-e500c1a46f75 req-d21b5d53-a806-4c0f-874e-a2db3ff5f593 service nova] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-42128592-f882-47b4-b112-e500c1a46f75 req-d21b5d53-a806-4c0f-874e-a2db3ff5f593 service nova] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-42128592-f882-47b4-b112-e500c1a46f75 req-d21b5d53-a806-4c0f-874e-a2db3ff5f593 service nova] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-42128592-f882-47b4-b112-e500c1a46f75 req-d21b5d53-a806-4c0f-874e-a2db3ff5f593 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] No waiting events found dispatching network-vif-plugged-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:59 user nova-compute[72426]: WARNING nova.compute.manager [req-42128592-f882-47b4-b112-e500c1a46f75 req-d21b5d53-a806-4c0f-874e-a2db3ff5f593 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received unexpected event network-vif-plugged-550346c3-b6a2-4aec-a520-93f161d77018 for instance with vm_state building and task_state spawning.
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:24:59 user nova-compute[72426]: INFO nova.compute.manager [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:24:59 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-3d9ff64d-6542-429d-b0bf-587cdbdbe5d3 req-6f80cecf-90af-4361-b2c9-a31bca2ca707 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-vif-unplugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3d9ff64d-6542-429d-b0bf-587cdbdbe5d3 req-6f80cecf-90af-4361-b2c9-a31bca2ca707 service nova] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3d9ff64d-6542-429d-b0bf-587cdbdbe5d3 req-6f80cecf-90af-4361-b2c9-a31bca2ca707 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3d9ff64d-6542-429d-b0bf-587cdbdbe5d3 req-6f80cecf-90af-4361-b2c9-a31bca2ca707 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-3d9ff64d-6542-429d-b0bf-587cdbdbe5d3 req-6f80cecf-90af-4361-b2c9-a31bca2ca707 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] No waiting events found dispatching network-vif-unplugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-3d9ff64d-6542-429d-b0bf-587cdbdbe5d3 req-6f80cecf-90af-4361-b2c9-a31bca2ca707 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-vif-unplugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:24:59 user nova-compute[72426]: INFO nova.compute.manager [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Took 7.68 seconds to build instance.
Aug 01 08:24:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-339b10ee-e6b0-4cee-9396-acd0aa7cca23 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.820s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:24:59 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Instance destroyed successfully.
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.objects.instance [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lazy-loading 'resources' on Instance uuid df66e0b7-acbf-48a2-b165-7d4a4fbf790d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:08:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-118503701',display_name='tempest-ServerActionsTestOtherA-server-1394724544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-118503701',id=3,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2cexpNp7ce31Ol7wfMnpUEuvgZu+7669cuU0GbcUwZ9y5YN46jqg6Nofw2Owo+jU7NYIZhTTp4Nfvc50H4vzm0EHKsbT7ZaKcgVzcTxqcEOty1ItLOhGLRP8T8P/kqAA==',key_name='tempest-keypair-1171081331',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:12:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77facd98c6ac4726939b5599e6c72a9b',ramdisk_id='',reservation_id='r-rcue7ywk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-355781192',owner_user_name='tempest-ServerActionsTestOtherA-355781192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63a663fe54d7469a97f5642e0847a2d4',uuid=df66e0b7-acbf-48a2-b165-7d4a4fbf790d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converting VIF {"id": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "address": "fa:16:3e:83:20:2c", "network": {"id": "8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1798029701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77facd98c6ac4726939b5599e6c72a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap883a5e52-34", "ovs_interfaceid": "883a5e52-3445-4ce9-aebd-8a5c59e18e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG os_vif [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap883a5e52-34, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:24:59 user nova-compute[72426]: INFO os_vif [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:20:2c,bridge_name='br-int',has_traffic_filtering=True,id=883a5e52-3445-4ce9-aebd-8a5c59e18e63,network=Network(8cd0c09d-d08f-49e9-bf69-3e4dc7ca66c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap883a5e52-34')
Aug 01 08:24:59 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Deleting instance files /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d_del
Aug 01 08:24:59 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Deletion of /opt/stack/data/nova/instances/df66e0b7-acbf-48a2-b165-7d4a4fbf790d_del complete
Aug 01 08:24:59 user nova-compute[72426]: INFO nova.compute.manager [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 01 08:24:59 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:24:59 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:25:00 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:25:00 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Took 0.73 seconds to deallocate network for instance.
Aug 01 08:25:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:01 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:25:01 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:25:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:01 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Deleted allocations for instance df66e0b7-acbf-48a2-b165-7d4a4fbf790d
Aug 01 08:25:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-946484fe-5c8f-4be2-bcbb-2daf3345d867 req-3469a55a-e97f-407a-9255-e072a08a0b03 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-946484fe-5c8f-4be2-bcbb-2daf3345d867 req-3469a55a-e97f-407a-9255-e072a08a0b03 service nova] Acquiring lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-946484fe-5c8f-4be2-bcbb-2daf3345d867 req-3469a55a-e97f-407a-9255-e072a08a0b03 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-946484fe-5c8f-4be2-bcbb-2daf3345d867 req-3469a55a-e97f-407a-9255-e072a08a0b03 service nova] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-946484fe-5c8f-4be2-bcbb-2daf3345d867 req-3469a55a-e97f-407a-9255-e072a08a0b03 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] No waiting events found dispatching network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:25:01 user nova-compute[72426]: WARNING nova.compute.manager [req-946484fe-5c8f-4be2-bcbb-2daf3345d867 req-3469a55a-e97f-407a-9255-e072a08a0b03 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received unexpected event network-vif-plugged-883a5e52-3445-4ce9-aebd-8a5c59e18e63 for instance with vm_state deleted and task_state None.
Aug 01 08:25:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-946484fe-5c8f-4be2-bcbb-2daf3345d867 req-3469a55a-e97f-407a-9255-e072a08a0b03 service nova] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Received event network-vif-deleted-883a5e52-3445-4ce9-aebd-8a5c59e18e63 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bb248a34-7d6b-4d1b-9f6e-af3aef21e5eb tempest-ServerActionsTestOtherA-355781192 tempest-ServerActionsTestOtherA-355781192-project-member] Lock "df66e0b7-acbf-48a2-b165-7d4a4fbf790d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.970s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:03 user nova-compute[72426]: INFO nova.compute.manager [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Detaching volume 48d014d6-cdb5-4efa-adcf-9cbc69a6026a
Aug 01 08:25:03 user nova-compute[72426]: INFO nova.virt.block_device [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Attempting to driver detach volume 48d014d6-cdb5-4efa-adcf-9cbc69a6026a from mountpoint /dev/vdb
Aug 01 08:25:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Attempting to detach device vdb from instance 05637642-f020-48af-b44a-d48e25a598fa from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:25:03 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:25:03 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:25:03 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:25:03 user nova-compute[72426]:   <serial>48d014d6-cdb5-4efa-adcf-9cbc69a6026a</serial>
Aug 01 08:25:03 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:25:03 user nova-compute[72426]: </disk>
Aug 01 08:25:03 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:25:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Successfully detached device vdb from instance 05637642-f020-48af-b44a-d48e25a598fa from the persistent domain config.
Aug 01 08:25:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05637642-f020-48af-b44a-d48e25a598fa from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:25:03 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:25:03 user nova-compute[72426]:   <source dev="/dev/sdf"/>
Aug 01 08:25:03 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:25:03 user nova-compute[72426]:   <serial>48d014d6-cdb5-4efa-adcf-9cbc69a6026a</serial>
Aug 01 08:25:03 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:25:03 user nova-compute[72426]: </disk>
Aug 01 08:25:03 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878303.6053255, 05637642-f020-48af-b44a-d48e25a598fa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:25:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Successfully detached device vdb from instance 05637642-f020-48af-b44a-d48e25a598fa from the live domain config.
Aug 01 08:25:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwiNoeEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:25:03 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fae60f2-c18a-4e21-827d-5332062a6bf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d188722-3dc7-48c5-b13a-3ff292fcec4f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:25:03 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:25:03 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:25:03 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:25:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:25:03 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:25:03 user nova-compute[72426]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a (non-flash)
Aug 01 08:25:03 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:25:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38a20b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a'): ({'sdf'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Removing single pathed devices sdf {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbb7602-29cc-4ff4-bf90-a3eeef56416d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf32ba32-8012-4092-9eff-8a856b05174e]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Flushing IO for device /dev/sdf {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7348ef20-ad1c-432f-8565-a140054d17b8]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[23779723-d411-4231-a506-e97fd5616475]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] SCSI volumes sdf have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ab01c2-3cff-48bb-b2ee-12543cc17d72]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aa091f-2295-48e3-9dbd-10466b72e6ad]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a, portal: 172.16.0.220,3260]
Aug 01 08:25:03 user nova-compute[72426]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a, portal: 172.16.0.220,3260] successful.
Aug 01 08:25:03 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d014d6-cdb5-4efa-adcf-9cbc69a6026a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed871ed-9006-46f7-a19c-75042f11f8c1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] <== disconnect_volume: return (295ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:25:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:25:04 user nova-compute[72426]: DEBUG nova.objects.instance [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'flavor' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b77ad226-e768-48ad-887f-c4a03625ed68 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.794s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:14 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878299.734865, df66e0b7-acbf-48a2-b165-7d4a4fbf790d => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:25:14 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] VM Stopped (Lifecycle Event)
Aug 01 08:25:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8e562138-3df7-49aa-a53e-7815062730da None None] [instance: df66e0b7-acbf-48a2-b165-7d4a4fbf790d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:25:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:25:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquired lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG nova.network.neutron [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'info_cache' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Updating instance_info_cache with network_info: [{"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Releasing lock "refresh_cache-e1119088-18c7-483d-a89d-3b5d19054e52" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:34 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance destroyed successfully.
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.objects.instance [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'resources' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-786606183',display_name='tempest-AttachVolumeTestJSON-server-786606183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-786606183',id=27,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhMcMLFpWRtcugrzk5/raTjStSXB9ipq79Xl+iZRLvhAJzQsUrNTa4A33Y+LFLAJhexCpWGTXgzOp8ywgg15r2gAc8AxCfNY7zz3j9aWRNC0qS56zJkCjoe3hYKglRjfQ==',key_name='tempest-keypair-1553423732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-rcziynoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=e1119088-18c7-483d-a89d-3b5d19054e52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG os_vif [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f0b410f-c4, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:34 user nova-compute[72426]: INFO os_vif [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4')
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Start _get_guest_xml network_info=[{"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.objects.instance [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'numa_topology' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:34 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:25:34 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.objects.instance [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-786606183',display_name='tempest-AttachVolumeTestJSON-server-786606183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-786606183',id=27,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhMcMLFpWRtcugrzk5/raTjStSXB9ipq79Xl+iZRLvhAJzQsUrNTa4A33Y+LFLAJhexCpWGTXgzOp8ywgg15r2gAc8AxCfNY7zz3j9aWRNC0qS56zJkCjoe3hYKglRjfQ==',key_name='tempest-keypair-1553423732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-rcziynoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=e1119088-18c7-483d-a89d-3b5d19054e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.objects.instance [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'pci_devices' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:25:34 user nova-compute[72426]:   <uuid>e1119088-18c7-483d-a89d-3b5d19054e52</uuid>
Aug 01 08:25:34 user nova-compute[72426]:   <name>instance-0000001b</name>
Aug 01 08:25:34 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:25:34 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:25:34 user nova-compute[72426]:   <metadata>
Aug 01 08:25:34 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:25:34 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:25:34 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeTestJSON-server-786606183</nova:name>
Aug 01 08:25:34 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:25:34</nova:creationTime>
Aug 01 08:25:34 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:25:34 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:25:34 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:25:34 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:25:34 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:25:34 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:25:34 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:25:34 user nova-compute[72426]:       <nova:owner>
Aug 01 08:25:34 user nova-compute[72426]:         <nova:user uuid="aab05095eb5347ea9f7e4f7bf33a089a">tempest-AttachVolumeTestJSON-173754033-project-member</nova:user>
Aug 01 08:25:34 user nova-compute[72426]:         <nova:project uuid="f4d025ba4c824773bbeedb7981910a9a">tempest-AttachVolumeTestJSON-173754033</nova:project>
Aug 01 08:25:34 user nova-compute[72426]:       </nova:owner>
Aug 01 08:25:34 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:25:34 user nova-compute[72426]:       <nova:ports>
Aug 01 08:25:34 user nova-compute[72426]:         <nova:port uuid="9f0b410f-c412-4817-9db3-b9ec5ffe8c09">
Aug 01 08:25:34 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 08:25:34 user nova-compute[72426]:         </nova:port>
Aug 01 08:25:34 user nova-compute[72426]:       </nova:ports>
Aug 01 08:25:34 user nova-compute[72426]:     </nova:instance>
Aug 01 08:25:34 user nova-compute[72426]:   </metadata>
Aug 01 08:25:34 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:25:34 user nova-compute[72426]:     <system>
Aug 01 08:25:34 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:25:34 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:25:34 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:25:34 user nova-compute[72426]:       <entry name="serial">e1119088-18c7-483d-a89d-3b5d19054e52</entry>
Aug 01 08:25:34 user nova-compute[72426]:       <entry name="uuid">e1119088-18c7-483d-a89d-3b5d19054e52</entry>
Aug 01 08:25:34 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:25:34 user nova-compute[72426]:     </system>
Aug 01 08:25:34 user nova-compute[72426]:   </sysinfo>
Aug 01 08:25:34 user nova-compute[72426]:   <os>
Aug 01 08:25:34 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:25:34 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:25:34 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:25:34 user nova-compute[72426]:   </os>
Aug 01 08:25:34 user nova-compute[72426]:   <features>
Aug 01 08:25:34 user nova-compute[72426]:     <acpi/>
Aug 01 08:25:34 user nova-compute[72426]:     <apic/>
Aug 01 08:25:34 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:25:34 user nova-compute[72426]:   </features>
Aug 01 08:25:34 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:25:34 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:25:34 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:25:34 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:25:34 user nova-compute[72426]:   </clock>
Aug 01 08:25:34 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:25:34 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:25:34 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:25:34 user nova-compute[72426]:   </cpu>
Aug 01 08:25:34 user nova-compute[72426]:   <devices>
Aug 01 08:25:34 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:25:34 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:25:34 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk"/>
Aug 01 08:25:34 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:25:34 user nova-compute[72426]:     </disk>
Aug 01 08:25:34 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:25:34 user nova-compute[72426]:       <mac address="fa:16:3e:d4:cf:4b"/>
Aug 01 08:25:34 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:25:34 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:25:34 user nova-compute[72426]:       <target dev="tap9f0b410f-c4"/>
Aug 01 08:25:34 user nova-compute[72426]:     </interface>
Aug 01 08:25:34 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:25:34 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/console.log" append="off"/>
Aug 01 08:25:34 user nova-compute[72426]:     </serial>
Aug 01 08:25:34 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:25:34 user nova-compute[72426]:     <video>
Aug 01 08:25:34 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:25:34 user nova-compute[72426]:     </video>
Aug 01 08:25:34 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:25:34 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:25:34 user nova-compute[72426]:     </rng>
Aug 01 08:25:34 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:25:34 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:25:34 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:25:34 user nova-compute[72426]:     </memballoon>
Aug 01 08:25:34 user nova-compute[72426]:   </devices>
Aug 01 08:25:34 user nova-compute[72426]: </domain>
Aug 01 08:25:34 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:25:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.502s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:35 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:25:35 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=6855MB free_disk=24.872787475585938GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.objects.instance [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'trusted_certs' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 73fb06b8-0824-42fc-bbfd-6914bdb78824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance e1119088-18c7-483d-a89d-3b5d19054e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 05637642-f020-48af-b44a-d48e25a598fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance b4d8cd69-296b-4253-badc-75e771af39b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 37dab412-5a15-46e8-844e-2ef0c03b7181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c707f931-d77d-44c8-a352-49e673ff6c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 468edb40-0972-4589-9395-826c1eeb0dc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 8fff7c8e-8129-40f3-ac3b-9b60408705ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 1fc3bc29-8fc0-41ee-b54c-90d960996c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Refreshing inventories for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Updating ProviderTree inventory for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Updating inventory in ProviderTree for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Refreshing aggregate associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, aggregates: None {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Refreshing trait associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, traits: COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Cannot resize image /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.objects.instance [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'migration_context' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-786606183',display_name='tempest-AttachVolumeTestJSON-server-786606183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-786606183',id=27,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhMcMLFpWRtcugrzk5/raTjStSXB9ipq79Xl+iZRLvhAJzQsUrNTa4A33Y+LFLAJhexCpWGTXgzOp8ywgg15r2gAc8AxCfNY7zz3j9aWRNC0qS56zJkCjoe3hYKglRjfQ==',key_name='tempest-keypair-1553423732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-rcziynoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=e1119088-18c7-483d-a89d-3b5d19054e52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG os_vif [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f0b410f-c4, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f0b410f-c4, col_values=(('external_ids', {'iface-id': '9f0b410f-c412-4817-9db3-b9ec5ffe8c09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:cf:4b', 'vm-uuid': 'e1119088-18c7-483d-a89d-3b5d19054e52'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:35 user nova-compute[72426]: INFO os_vif [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4')
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:25:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.743s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG nova.compute.manager [req-3814e28c-7b23-45c1-a667-0536140e4a3c req-f892294d-8b76-442a-8115-00a577d5e473 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3814e28c-7b23-45c1-a667-0536140e4a3c req-f892294d-8b76-442a-8115-00a577d5e473 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3814e28c-7b23-45c1-a667-0536140e4a3c req-f892294d-8b76-442a-8115-00a577d5e473 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3814e28c-7b23-45c1-a667-0536140e4a3c req-f892294d-8b76-442a-8115-00a577d5e473 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG nova.compute.manager [req-3814e28c-7b23-45c1-a667-0536140e4a3c req-f892294d-8b76-442a-8115-00a577d5e473 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:25:37 user nova-compute[72426]: WARNING nova.compute.manager [req-3814e28c-7b23-45c1-a667-0536140e4a3c req-f892294d-8b76-442a-8115-00a577d5e473 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state stopped and task_state powering-on.
Aug 01 08:25:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:25:37 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updating instance_info_cache with network_info: [{"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG nova.objects.instance [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'flavor' on Instance uuid bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:38 user nova-compute[72426]: INFO nova.compute.manager [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Attaching volume ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 to /dev/vdb
Aug 01 08:25:38 user nova-compute[72426]: DEBUG os_brick.utils [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb4ac42-14f3-4da2-9672-076967b67e80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e97d24-1757-4308-b975-f5c7cb0b8055]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5e58c4-7a39-4bfc-b701-585fde153f5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[80afd605-d3c7-45d3-8878-69d37185ab84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:25:38 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:25:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6739db16-673a-4021-b090-8490eafe2a9f]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG os_brick.utils [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:25:38 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updating existing volume attachment record: e3a5d3f9-9ca6-4475-830c-e09a735400bc {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878339.0812235, e1119088-18c7-483d-a89d-3b5d19054e52 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:25:39 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] VM Resumed (Lifecycle Event)
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:25:39 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance rebooted successfully.
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-07f670f7-4f29-402a-a728-91018709c4c3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:25:39 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878339.0833197, e1119088-18c7-483d-a89d-3b5d19054e52 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:25:39 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] VM Started (Lifecycle Event)
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [req-6d789983-f5df-427b-8aac-66d9d73a6c92 req-b7b3791d-edc4-4417-8d54-55ca639c83a3 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6d789983-f5df-427b-8aac-66d9d73a6c92 req-b7b3791d-edc4-4417-8d54-55ca639c83a3 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6d789983-f5df-427b-8aac-66d9d73a6c92 req-b7b3791d-edc4-4417-8d54-55ca639c83a3 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6d789983-f5df-427b-8aac-66d9d73a6c92 req-b7b3791d-edc4-4417-8d54-55ca639c83a3 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [req-6d789983-f5df-427b-8aac-66d9d73a6c92 req-b7b3791d-edc4-4417-8d54-55ca639c83a3 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:25:39 user nova-compute[72426]: WARNING nova.compute.manager [req-6d789983-f5df-427b-8aac-66d9d73a6c92 req-b7b3791d-edc4-4417-8d54-55ca639c83a3 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state active and task_state None.
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid c10d6140-aa17-4342-9135-d07a73285483 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 73fb06b8-0824-42fc-bbfd-6914bdb78824 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid b4d8cd69-296b-4253-badc-75e771af39b8 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 37dab412-5a15-46e8-844e-2ef0c03b7181 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 8fff7c8e-8129-40f3-ac3b-9b60408705ac {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 1fc3bc29-8fc0-41ee-b54c-90d960996c41 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "c10d6140-aa17-4342-9135-d07a73285483" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "c10d6140-aa17-4342-9135-d07a73285483" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "73fb06b8-0824-42fc-bbfd-6914bdb78824" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "05637642-f020-48af-b44a-d48e25a598fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "b4d8cd69-296b-4253-badc-75e771af39b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "468edb40-0972-4589-9395-826c1eeb0dc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "c10d6140-aa17-4342-9135-d07a73285483" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "05637642-f020-48af-b44a-d48e25a598fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "b4d8cd69-296b-4253-badc-75e771af39b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "468edb40-0972-4589-9395-826c1eeb0dc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "b4d8cd69-296b-4253-badc-75e771af39b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:44 user nova-compute[72426]: INFO nova.compute.manager [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Terminating instance
Aug 01 08:25:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-23e040e7-1afb-4bcd-bf18-1e22ed97eccd req-d30bf420-d77b-49e0-99b7-1fe70e47baf3 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-unplugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-23e040e7-1afb-4bcd-bf18-1e22ed97eccd req-d30bf420-d77b-49e0-99b7-1fe70e47baf3 service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-23e040e7-1afb-4bcd-bf18-1e22ed97eccd req-d30bf420-d77b-49e0-99b7-1fe70e47baf3 service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-23e040e7-1afb-4bcd-bf18-1e22ed97eccd req-d30bf420-d77b-49e0-99b7-1fe70e47baf3 service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-23e040e7-1afb-4bcd-bf18-1e22ed97eccd req-d30bf420-d77b-49e0-99b7-1fe70e47baf3 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-unplugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-23e040e7-1afb-4bcd-bf18-1e22ed97eccd req-d30bf420-d77b-49e0-99b7-1fe70e47baf3 service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-unplugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Instance destroyed successfully.
Aug 01 08:25:45 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'resources' on Instance uuid b4d8cd69-296b-4253-badc-75e771af39b8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1709557568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1709557568',id=31,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:22:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-rgo0dk5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:23:58Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=b4d8cd69-296b-4253-badc-75e771af39b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "address": "fa:16:3e:0d:ae:14", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57a2eab-08", "ovs_interfaceid": "f57a2eab-0805-47c8-a545-d2e08590b2d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=f57a2eab-0805-47c8-a545-d2e08590b2d1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57a2eab-08') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_vif [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=f57a2eab-0805-47c8-a545-d2e08590b2d1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57a2eab-08') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf57a2eab-08, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:25:45 user nova-compute[72426]: INFO os_vif [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ae:14,bridge_name='br-int',has_traffic_filtering=True,id=f57a2eab-0805-47c8-a545-d2e08590b2d1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57a2eab-08')
Aug 01 08:25:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZfTOxPc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:25:45 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d80ca8-3076-4ece-9c2b-195aa9c27ddb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[71324497-bce8-48e3-bf50-c0037549c937]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:25:45 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:25:45 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:25:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:25:45 user nova-compute[72426]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a (non-flash)
Aug 01 08:25:45 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:25:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38df4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a'): ({'sdd'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Removing single pathed devices sdd {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34515ce-2779-41e1-96db-8f516ea2d347]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f00dc4-8baa-46e4-8c71-90b12bb8b0f7]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flushing IO for device /dev/sdd {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74dfd2a-5a71-4227-a779-55a875217088]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe3c068-e89c-431d-90eb-56abfaf0714c]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_780233f6', '/dev/disk/by-id/scsi-26435323135613531', '/dev/disk/by-id/scsi-1SCST_BIO780233f6-d5215a51bb7741ba') {{(pid=83442) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a263e667-c450-4f0c-a187-69a3149e3e8e]: (4, None) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f834122-79ca-44a9-867c-f2840627a5a6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f95dd0-2ea5-432f-a77b-5cc30f62cec6]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a, portal: 172.16.0.220,3260]
Aug 01 08:25:45 user nova-compute[72426]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a, portal: 172.16.0.220,3260] successful.
Aug 01 08:25:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04960353-544b-49a8-b57f-567aa153b78a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc6ce0b-b76f-40c8-bfef-ceb39afd3ae4]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] <== disconnect_volume: return (289ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:25:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Deleting instance files /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8_del
Aug 01 08:25:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Deletion of /opt/stack/data/nova/instances/b4d8cd69-296b-4253-badc-75e771af39b8_del complete
Aug 01 08:25:45 user nova-compute[72426]: INFO nova.compute.manager [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 01 08:25:45 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:25:45 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:25:46 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Took 0.58 seconds to deallocate network for instance.
Aug 01 08:25:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-8e4c6c4f-602a-4b5f-930b-49a2304874df req-9339bdb9-b7f6-4b97-8204-b5123bbecc8b service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-deleted-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWRprNBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:25:46 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:25:46 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:25:46 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd495706-d11a-418f-ad69-3f9a588b44f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:25:46 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2694cb3f-7b7d-4a72-a88b-b8d15d0988ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8] added
Aug 01 08:25:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddc964a-f16f-4f90-8bf6-ce92f0258612]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-ad05be87-1531-4ba4-b798-2cb1e533a3c2 req-ca35214a-41df-4d17-a568-ce80b34cb1dd service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ad05be87-1531-4ba4-b798-2cb1e533a3c2 req-ca35214a-41df-4d17-a568-ce80b34cb1dd service nova] Acquiring lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ad05be87-1531-4ba4-b798-2cb1e533a3c2 req-ca35214a-41df-4d17-a568-ce80b34cb1dd service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ad05be87-1531-4ba4-b798-2cb1e533a3c2 req-ca35214a-41df-4d17-a568-ce80b34cb1dd service nova] Lock "b4d8cd69-296b-4253-badc-75e771af39b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-ad05be87-1531-4ba4-b798-2cb1e533a3c2 req-ca35214a-41df-4d17-a568-ce80b34cb1dd service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] No waiting events found dispatching network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:25:46 user nova-compute[72426]: WARNING nova.compute.manager [req-ad05be87-1531-4ba4-b798-2cb1e533a3c2 req-ca35214a-41df-4d17-a568-ce80b34cb1dd service nova] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Received unexpected event network-vif-plugged-f57a2eab-0805-47c8-a545-d2e08590b2d1 for instance with vm_state active and task_state deleting.
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[818a8f2c-ab7b-4a24-a7cb-45723bc6b7aa]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bWRprNBS {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bWRprNBS" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19aae88-09e6-456f-af68-cdc758c7de55]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bWRprNBS'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5722f93a-1cc1-49a2-8973-6dec7a392494]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d131f94-f2a0-4bcc-ab55-81abf7514be8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:25:46 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:25:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:25:46 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:25:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c635ca-c095-4e7d-80b4-882f8f1404f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8, portal: 172.16.0.220,3260]
Aug 01 08:25:46 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8, portal: 172.16.0.220,3260] successful.
Aug 01 08:25:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d41c83-f752-4274-95ff-5fb1243ef8db]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[72960085-2e19-47d8-b137-4f33c4bd16cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:25:46 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:25:46 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:25:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:25:46 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:25:46 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:25:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2282b14b-6887-4636-b39d-34e12240d19e]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:25:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWRprNBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:25:47 user nova-compute[72426]: INFO nova.compute.manager [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Took 1.01 seconds to detach 1 volumes for instance.
Aug 01 08:25:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:47 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:25:47 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:25:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:47 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Deleted allocations for instance b4d8cd69-296b-4253-badc-75e771af39b8
Aug 01 08:25:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e016850-f246-4140-a8d5-42bcb8dcfaa3 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "b4d8cd69-296b-4253-badc-75e771af39b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.406s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:25:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23562333362353366', 'path': '/dev/sdd'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:25:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562333362353366', 'path': '/dev/sdd'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:25:47 user nova-compute[72426]: DEBUG nova.objects.instance [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'flavor' on Instance uuid bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:25:48 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:25:48 user nova-compute[72426]:   <source dev="/dev/sdd"/>
Aug 01 08:25:48 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:25:48 user nova-compute[72426]:   <serial>ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8</serial>
Aug 01 08:25:48 user nova-compute[72426]: </disk>
Aug 01 08:25:48 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:25:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:25:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:25:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] No VIF found with MAC fa:16:3e:21:be:c4, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:25:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-29024af2-e19a-4306-9f34-323e9c90fb36 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.748s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.793s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-59623b85-519a-476d-a691-4b72916a8839 req-0956f2aa-6d91-45f4-90c2-60cf196fe36f service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-changed-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-59623b85-519a-476d-a691-4b72916a8839 req-0956f2aa-6d91-45f4-90c2-60cf196fe36f service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Refreshing instance network info cache due to event network-changed-1705fdbb-5832-4b95-8bde-3ba0de7a4f34. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:25:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59623b85-519a-476d-a691-4b72916a8839 req-0956f2aa-6d91-45f4-90c2-60cf196fe36f service nova] Acquiring lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:25:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59623b85-519a-476d-a691-4b72916a8839 req-0956f2aa-6d91-45f4-90c2-60cf196fe36f service nova] Acquired lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:25:52 user nova-compute[72426]: DEBUG nova.network.neutron [req-59623b85-519a-476d-a691-4b72916a8839 req-0956f2aa-6d91-45f4-90c2-60cf196fe36f service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Refreshing network info cache for port 1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:25:52 user nova-compute[72426]: DEBUG nova.network.neutron [req-59623b85-519a-476d-a691-4b72916a8839 req-0956f2aa-6d91-45f4-90c2-60cf196fe36f service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updated VIF entry in instance network info cache for port 1705fdbb-5832-4b95-8bde-3ba0de7a4f34. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:25:52 user nova-compute[72426]: DEBUG nova.network.neutron [req-59623b85-519a-476d-a691-4b72916a8839 req-0956f2aa-6d91-45f4-90c2-60cf196fe36f service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updating instance_info_cache with network_info: [{"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:25:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59623b85-519a-476d-a691-4b72916a8839 req-0956f2aa-6d91-45f4-90c2-60cf196fe36f service nova] Releasing lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:25:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:53 user nova-compute[72426]: INFO nova.compute.manager [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Terminating instance
Aug 01 08:25:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:25:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-8e242099-5323-4dee-ad9d-94e4b51ea1f1 req-7b38820b-f206-4e75-b262-ef61193e353a service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-unplugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8e242099-5323-4dee-ad9d-94e4b51ea1f1 req-7b38820b-f206-4e75-b262-ef61193e353a service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8e242099-5323-4dee-ad9d-94e4b51ea1f1 req-7b38820b-f206-4e75-b262-ef61193e353a service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8e242099-5323-4dee-ad9d-94e4b51ea1f1 req-7b38820b-f206-4e75-b262-ef61193e353a service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-8e242099-5323-4dee-ad9d-94e4b51ea1f1 req-7b38820b-f206-4e75-b262-ef61193e353a service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-unplugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-8e242099-5323-4dee-ad9d-94e4b51ea1f1 req-7b38820b-f206-4e75-b262-ef61193e353a service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-unplugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:25:54 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Instance destroyed successfully.
Aug 01 08:25:54 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lazy-loading 'resources' on Instance uuid 05637642-f020-48af-b44a-d48e25a598fa {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1014751889',display_name='tempest-ServerStableDeviceRescueTest-server-1014751889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1014751889',id=29,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGOczwmFIF55GGK0yKw5W7YLyfKHgYEMleHXa1e7A8MknpSoOlTzKBkR5G0uCw9iSq/ILIoMjQkOSEKackU9urf9ByZ5uU7DY7Bf6h+tbWMKty249vXPajHXhkV+AIjA==',key_name='tempest-keypair-1725080813',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:22:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c67c5b96fae746229b2f90b37110c703',ramdisk_id='',reservation_id='r-nz4656dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2126677985',owner_user_name='tempest-ServerStableDeviceRescueTest-2126677985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:24:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd6a35cf8d4ed786314f9a680fa4cc',uuid=05637642-f020-48af-b44a-d48e25a598fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Converting VIF {"id": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "address": "fa:16:3e:eb:91:18", "network": {"id": "f0be2463-2fb0-4b0c-aeb2-c36a43962363", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-108487498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c67c5b96fae746229b2f90b37110c703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa87f8f30-66", "ovs_interfaceid": "a87f8f30-667e-4321-9d19-04f12f45eb7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:91:18,bridge_name='br-int',has_traffic_filtering=True,id=a87f8f30-667e-4321-9d19-04f12f45eb7f,network=Network(f0be2463-2fb0-4b0c-aeb2-c36a43962363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87f8f30-66') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG os_vif [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:91:18,bridge_name='br-int',has_traffic_filtering=True,id=a87f8f30-667e-4321-9d19-04f12f45eb7f,network=Network(f0be2463-2fb0-4b0c-aeb2-c36a43962363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87f8f30-66') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa87f8f30-66, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:54 user nova-compute[72426]: INFO os_vif [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:91:18,bridge_name='br-int',has_traffic_filtering=True,id=a87f8f30-667e-4321-9d19-04f12f45eb7f,network=Network(f0be2463-2fb0-4b0c-aeb2-c36a43962363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa87f8f30-66')
Aug 01 08:25:54 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Deleting instance files /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa_del
Aug 01 08:25:54 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Deletion of /opt/stack/data/nova/instances/05637642-f020-48af-b44a-d48e25a598fa_del complete
Aug 01 08:25:54 user nova-compute[72426]: INFO nova.compute.manager [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 08:25:54 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 05637642-f020-48af-b44a-d48e25a598fa] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:54 user nova-compute[72426]: INFO nova.compute.manager [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Rebooting instance
Aug 01 08:25:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquired lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:25:54 user nova-compute[72426]: DEBUG nova.network.neutron [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-changed-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Refreshing instance network info cache due to event network-changed-1705fdbb-5832-4b95-8bde-3ba0de7a4f34. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] Acquiring lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.network.neutron [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updating instance_info_cache with network_info: [{"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Releasing lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] Acquired lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.network.neutron [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Refreshing network info cache for port 1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:25:56 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Took 1.77 seconds to deallocate network for instance.
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-edba3d1d-3e78-4e99-98a0-eee5fdcd9328 req-7b9b7f23-7af4-4092-bc06-953d9990ea9d service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-deleted-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.network.neutron [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updated VIF entry in instance network info cache for port 1705fdbb-5832-4b95-8bde-3ba0de7a4f34. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.network.neutron [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updating instance_info_cache with network_info: [{"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] Releasing lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] Acquiring lock "05637642-f020-48af-b44a-d48e25a598fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] Lock "05637642-f020-48af-b44a-d48e25a598fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] No waiting events found dispatching network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:25:56 user nova-compute[72426]: WARNING nova.compute.manager [req-705d7407-2f52-4fb7-bc72-db1a515be8ff req-a68bd329-e832-4abf-b295-40cdcc54f773 service nova] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Received unexpected event network-vif-plugged-a87f8f30-667e-4321-9d19-04f12f45eb7f for instance with vm_state active and task_state deleting.
Aug 01 08:25:57 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:25:57 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:25:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:57 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Deleted allocations for instance 05637642-f020-48af-b44a-d48e25a598fa
Aug 01 08:25:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f01f83d0-c48f-4b7f-a0df-20086b9bec36 tempest-ServerStableDeviceRescueTest-2126677985 tempest-ServerStableDeviceRescueTest-2126677985-project-member] Lock "05637642-f020-48af-b44a-d48e25a598fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.508s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:25:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-849b843d-2765-4738-b5d7-39397d8383af req-9d5dc312-757c-481d-8da1-500f11ba5bcb service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-unplugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:25:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-849b843d-2765-4738-b5d7-39397d8383af req-9d5dc312-757c-481d-8da1-500f11ba5bcb service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:25:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-849b843d-2765-4738-b5d7-39397d8383af req-9d5dc312-757c-481d-8da1-500f11ba5bcb service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:25:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-849b843d-2765-4738-b5d7-39397d8383af req-9d5dc312-757c-481d-8da1-500f11ba5bcb service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:25:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-849b843d-2765-4738-b5d7-39397d8383af req-9d5dc312-757c-481d-8da1-500f11ba5bcb service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-unplugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:25:59 user nova-compute[72426]: WARNING nova.compute.manager [req-849b843d-2765-4738-b5d7-39397d8383af req-9d5dc312-757c-481d-8da1-500f11ba5bcb service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received unexpected event network-vif-unplugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with vm_state active and task_state reboot_started.
Aug 01 08:25:59 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Instance shutdown successfully.
Aug 01 08:25:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:00 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878345.1805453, b4d8cd69-296b-4253-badc-75e771af39b8 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:00 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] VM Stopped (Lifecycle Event)
Aug 01 08:26:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6e708dcf-b6c1-4f36-b841-80e71e6473e2 None None] [instance: b4d8cd69-296b-4253-badc-75e771af39b8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:00 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:00 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-e8150797-77fc-4e75-a8e8-c9482e86992d req-e5f3799c-e331-4815-9f33-810efbe006f8 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e8150797-77fc-4e75-a8e8-c9482e86992d req-e5f3799c-e331-4815-9f33-810efbe006f8 service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e8150797-77fc-4e75-a8e8-c9482e86992d req-e5f3799c-e331-4815-9f33-810efbe006f8 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e8150797-77fc-4e75-a8e8-c9482e86992d req-e5f3799c-e331-4815-9f33-810efbe006f8 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-e8150797-77fc-4e75-a8e8-c9482e86992d req-e5f3799c-e331-4815-9f33-810efbe006f8 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:01 user nova-compute[72426]: WARNING nova.compute.manager [req-e8150797-77fc-4e75-a8e8-c9482e86992d req-e5f3799c-e331-4815-9f33-810efbe006f8 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received unexpected event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with vm_state active and task_state reboot_started.
Aug 01 08:26:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:03 user nova-compute[72426]: WARNING nova.compute.manager [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received unexpected event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with vm_state active and task_state reboot_started.
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:03 user nova-compute[72426]: WARNING nova.compute.manager [req-cad1dc8a-97bc-4909-9a34-913f63dbc5e9 req-31acfb17-182e-41f4-922a-d09a884d1e13 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received unexpected event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with vm_state active and task_state reboot_started.
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878363.2626975, bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:03 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] VM Resumed (Lifecycle Event)
Aug 01 08:26:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Instance running successfully.
Aug 01 08:26:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Instance soft rebooted successfully.
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:26:03 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878363.2634268, bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:03 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] VM Started (Lifecycle Event)
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-861db150-a37d-4841-8293-3d63bcaa48b9 tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.433s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:26:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-5af5927e-0cfd-48c9-8ca8-f9dad3b9cb89 req-b846668e-9b24-4749-bf5e-269d1512f50f service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-changed-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-5af5927e-0cfd-48c9-8ca8-f9dad3b9cb89 req-b846668e-9b24-4749-bf5e-269d1512f50f service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Refreshing instance network info cache due to event network-changed-f2a59028-82a7-4744-82f8-b9b0ec197596. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:26:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5af5927e-0cfd-48c9-8ca8-f9dad3b9cb89 req-b846668e-9b24-4749-bf5e-269d1512f50f service nova] Acquiring lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:26:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5af5927e-0cfd-48c9-8ca8-f9dad3b9cb89 req-b846668e-9b24-4749-bf5e-269d1512f50f service nova] Acquired lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:26:04 user nova-compute[72426]: DEBUG nova.network.neutron [req-5af5927e-0cfd-48c9-8ca8-f9dad3b9cb89 req-b846668e-9b24-4749-bf5e-269d1512f50f service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Refreshing network info cache for port f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:26:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:04 user nova-compute[72426]: DEBUG nova.network.neutron [req-5af5927e-0cfd-48c9-8ca8-f9dad3b9cb89 req-b846668e-9b24-4749-bf5e-269d1512f50f service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updated VIF entry in instance network info cache for port f2a59028-82a7-4744-82f8-b9b0ec197596. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:26:04 user nova-compute[72426]: DEBUG nova.network.neutron [req-5af5927e-0cfd-48c9-8ca8-f9dad3b9cb89 req-b846668e-9b24-4749-bf5e-269d1512f50f service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updating instance_info_cache with network_info: [{"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5af5927e-0cfd-48c9-8ca8-f9dad3b9cb89 req-b846668e-9b24-4749-bf5e-269d1512f50f service nova] Releasing lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "9a381085-5df7-453e-8631-995ab647cabe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "9a381085-5df7-453e-8631-995ab647cabe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:26:06 user nova-compute[72426]: INFO nova.compute.claims [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Claim successful on node user
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:26:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.policy [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db1631e91f1462c9a1433fc10eba8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9859557c06bf4d50937390421acca14f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:26:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Creating image(s)
Aug 01 08:26:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "/opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "/opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.199s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk 1073741824" returned: 0 in 0.117s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.165s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Successfully created port: 014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Cannot resize image /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG nova.objects.instance [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lazy-loading 'migration_context' on Instance uuid 9a381085-5df7-453e-8631-995ab647cabe {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Ensure instance console log exists: /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Successfully updated port: 014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "refresh_cache-9a381085-5df7-453e-8631-995ab647cabe" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquired lock "refresh_cache-9a381085-5df7-453e-8631-995ab647cabe" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-90397a9a-cb79-4e21-a5c5-190f797f4a28 req-a540f53b-6377-4b1b-a15e-50a15500ce55 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Received event network-changed-014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-90397a9a-cb79-4e21-a5c5-190f797f4a28 req-a540f53b-6377-4b1b-a15e-50a15500ce55 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Refreshing instance network info cache due to event network-changed-014c7d18-8891-4ef4-af3e-72c15509fd5f. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-90397a9a-cb79-4e21-a5c5-190f797f4a28 req-a540f53b-6377-4b1b-a15e-50a15500ce55 service nova] Acquiring lock "refresh_cache-9a381085-5df7-453e-8631-995ab647cabe" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.network.neutron [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Updating instance_info_cache with network_info: [{"id": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "address": "fa:16:3e:9e:9e:99", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014c7d18-88", "ovs_interfaceid": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Releasing lock "refresh_cache-9a381085-5df7-453e-8631-995ab647cabe" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Instance network_info: |[{"id": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "address": "fa:16:3e:9e:9e:99", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014c7d18-88", "ovs_interfaceid": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-90397a9a-cb79-4e21-a5c5-190f797f4a28 req-a540f53b-6377-4b1b-a15e-50a15500ce55 service nova] Acquired lock "refresh_cache-9a381085-5df7-453e-8631-995ab647cabe" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.network.neutron [req-90397a9a-cb79-4e21-a5c5-190f797f4a28 req-a540f53b-6377-4b1b-a15e-50a15500ce55 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Refreshing network info cache for port 014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Start _get_guest_xml network_info=[{"id": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "address": "fa:16:3e:9e:9e:99", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014c7d18-88", "ovs_interfaceid": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:26:08 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:26:08 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:26:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-168140463',display_name='tempest-ServersNegativeTestJSON-server-168140463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-168140463',id=39,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9859557c06bf4d50937390421acca14f',ramdisk_id='',reservation_id='r-d0es2b4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-330621956',owner_user_name='tempest-ServersNegativeTestJSON-330621956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:26:07Z,user_data=None,user_id='6db1631e91f1462c9a1433fc10eba8bf',uuid=9a381085-5df7-453e-8631-995ab647cabe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "address": "fa:16:3e:9e:9e:99", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014c7d18-88", "ovs_interfaceid": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converting VIF {"id": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "address": "fa:16:3e:9e:9e:99", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014c7d18-88", "ovs_interfaceid": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9e:99,bridge_name='br-int',has_traffic_filtering=True,id=014c7d18-8891-4ef4-af3e-72c15509fd5f,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014c7d18-88') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.objects.instance [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a381085-5df7-453e-8631-995ab647cabe {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:26:09 user nova-compute[72426]:   <uuid>9a381085-5df7-453e-8631-995ab647cabe</uuid>
Aug 01 08:26:09 user nova-compute[72426]:   <name>instance-00000027</name>
Aug 01 08:26:09 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:26:09 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:26:09 user nova-compute[72426]:   <metadata>
Aug 01 08:26:09 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:26:09 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:26:09 user nova-compute[72426]:       <nova:name>tempest-ServersNegativeTestJSON-server-168140463</nova:name>
Aug 01 08:26:09 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:26:08</nova:creationTime>
Aug 01 08:26:09 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:26:09 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:26:09 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:26:09 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:26:09 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:26:09 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:26:09 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:26:09 user nova-compute[72426]:       <nova:owner>
Aug 01 08:26:09 user nova-compute[72426]:         <nova:user uuid="6db1631e91f1462c9a1433fc10eba8bf">tempest-ServersNegativeTestJSON-330621956-project-member</nova:user>
Aug 01 08:26:09 user nova-compute[72426]:         <nova:project uuid="9859557c06bf4d50937390421acca14f">tempest-ServersNegativeTestJSON-330621956</nova:project>
Aug 01 08:26:09 user nova-compute[72426]:       </nova:owner>
Aug 01 08:26:09 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:26:09 user nova-compute[72426]:       <nova:ports>
Aug 01 08:26:09 user nova-compute[72426]:         <nova:port uuid="014c7d18-8891-4ef4-af3e-72c15509fd5f">
Aug 01 08:26:09 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 08:26:09 user nova-compute[72426]:         </nova:port>
Aug 01 08:26:09 user nova-compute[72426]:       </nova:ports>
Aug 01 08:26:09 user nova-compute[72426]:     </nova:instance>
Aug 01 08:26:09 user nova-compute[72426]:   </metadata>
Aug 01 08:26:09 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:26:09 user nova-compute[72426]:     <system>
Aug 01 08:26:09 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:26:09 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:26:09 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:26:09 user nova-compute[72426]:       <entry name="serial">9a381085-5df7-453e-8631-995ab647cabe</entry>
Aug 01 08:26:09 user nova-compute[72426]:       <entry name="uuid">9a381085-5df7-453e-8631-995ab647cabe</entry>
Aug 01 08:26:09 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:26:09 user nova-compute[72426]:     </system>
Aug 01 08:26:09 user nova-compute[72426]:   </sysinfo>
Aug 01 08:26:09 user nova-compute[72426]:   <os>
Aug 01 08:26:09 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:26:09 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:26:09 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:26:09 user nova-compute[72426]:   </os>
Aug 01 08:26:09 user nova-compute[72426]:   <features>
Aug 01 08:26:09 user nova-compute[72426]:     <acpi/>
Aug 01 08:26:09 user nova-compute[72426]:     <apic/>
Aug 01 08:26:09 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:26:09 user nova-compute[72426]:   </features>
Aug 01 08:26:09 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:26:09 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:26:09 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:26:09 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:26:09 user nova-compute[72426]:   </clock>
Aug 01 08:26:09 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:26:09 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:26:09 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:26:09 user nova-compute[72426]:   </cpu>
Aug 01 08:26:09 user nova-compute[72426]:   <devices>
Aug 01 08:26:09 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:26:09 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:26:09 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk"/>
Aug 01 08:26:09 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:26:09 user nova-compute[72426]:     </disk>
Aug 01 08:26:09 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:26:09 user nova-compute[72426]:       <mac address="fa:16:3e:9e:9e:99"/>
Aug 01 08:26:09 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:26:09 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:26:09 user nova-compute[72426]:       <target dev="tap014c7d18-88"/>
Aug 01 08:26:09 user nova-compute[72426]:     </interface>
Aug 01 08:26:09 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:26:09 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/console.log" append="off"/>
Aug 01 08:26:09 user nova-compute[72426]:     </serial>
Aug 01 08:26:09 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:26:09 user nova-compute[72426]:     <video>
Aug 01 08:26:09 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:26:09 user nova-compute[72426]:     </video>
Aug 01 08:26:09 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:26:09 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:26:09 user nova-compute[72426]:     </rng>
Aug 01 08:26:09 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:26:09 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:26:09 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:26:09 user nova-compute[72426]:     </memballoon>
Aug 01 08:26:09 user nova-compute[72426]:   </devices>
Aug 01 08:26:09 user nova-compute[72426]: </domain>
Aug 01 08:26:09 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-168140463',display_name='tempest-ServersNegativeTestJSON-server-168140463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-168140463',id=39,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9859557c06bf4d50937390421acca14f',ramdisk_id='',reservation_id='r-d0es2b4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-330621956',owner_user_name='tempest-ServersNegativeTestJSON-330621956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:26:07Z,user_data=None,user_id='6db1631e91f1462c9a1433fc10eba8bf',uuid=9a381085-5df7-453e-8631-995ab647cabe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "address": "fa:16:3e:9e:9e:99", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014c7d18-88", "ovs_interfaceid": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converting VIF {"id": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "address": "fa:16:3e:9e:9e:99", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014c7d18-88", "ovs_interfaceid": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9e:99,bridge_name='br-int',has_traffic_filtering=True,id=014c7d18-8891-4ef4-af3e-72c15509fd5f,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014c7d18-88') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG os_vif [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9e:99,bridge_name='br-int',has_traffic_filtering=True,id=014c7d18-8891-4ef4-af3e-72c15509fd5f,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014c7d18-88') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap014c7d18-88, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap014c7d18-88, col_values=(('external_ids', {'iface-id': '014c7d18-8891-4ef4-af3e-72c15509fd5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:9e:99', 'vm-uuid': '9a381085-5df7-453e-8631-995ab647cabe'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:09 user nova-compute[72426]: INFO os_vif [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9e:99,bridge_name='br-int',has_traffic_filtering=True,id=014c7d18-8891-4ef4-af3e-72c15509fd5f,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014c7d18-88')
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] No VIF found with MAC fa:16:3e:9e:9e:99, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878354.4625986, 05637642-f020-48af-b44a-d48e25a598fa => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:09 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 05637642-f020-48af-b44a-d48e25a598fa] VM Stopped (Lifecycle Event)
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.network.neutron [req-90397a9a-cb79-4e21-a5c5-190f797f4a28 req-a540f53b-6377-4b1b-a15e-50a15500ce55 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Updated VIF entry in instance network info cache for port 014c7d18-8891-4ef4-af3e-72c15509fd5f. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.network.neutron [req-90397a9a-cb79-4e21-a5c5-190f797f4a28 req-a540f53b-6377-4b1b-a15e-50a15500ce55 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Updating instance_info_cache with network_info: [{"id": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "address": "fa:16:3e:9e:9e:99", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014c7d18-88", "ovs_interfaceid": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9f3583de-7894-4999-a20d-0fca5830b6e1 None None] [instance: 05637642-f020-48af-b44a-d48e25a598fa] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-90397a9a-cb79-4e21-a5c5-190f797f4a28 req-a540f53b-6377-4b1b-a15e-50a15500ce55 service nova] Releasing lock "refresh_cache-9a381085-5df7-453e-8631-995ab647cabe" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "468edb40-0972-4589-9395-826c1eeb0dc6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:09 user nova-compute[72426]: INFO nova.compute.manager [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Shelving
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-b534e15b-0aa0-4fae-824b-9b5918b0c53b req-82c89a81-8bc3-4a64-8a28-fe73c4b93f37 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-vif-unplugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b534e15b-0aa0-4fae-824b-9b5918b0c53b req-82c89a81-8bc3-4a64-8a28-fe73c4b93f37 service nova] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b534e15b-0aa0-4fae-824b-9b5918b0c53b req-82c89a81-8bc3-4a64-8a28-fe73c4b93f37 service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b534e15b-0aa0-4fae-824b-9b5918b0c53b req-82c89a81-8bc3-4a64-8a28-fe73c4b93f37 service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-b534e15b-0aa0-4fae-824b-9b5918b0c53b req-82c89a81-8bc3-4a64-8a28-fe73c4b93f37 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] No waiting events found dispatching network-vif-unplugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:10 user nova-compute[72426]: WARNING nova.compute.manager [req-b534e15b-0aa0-4fae-824b-9b5918b0c53b req-82c89a81-8bc3-4a64-8a28-fe73c4b93f37 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received unexpected event network-vif-unplugged-f2a59028-82a7-4744-82f8-b9b0ec197596 for instance with vm_state active and task_state shelving.
Aug 01 08:26:10 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Instance destroyed successfully.
Aug 01 08:26:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:11 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Beginning cold snapshot process
Aug 01 08:26:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-b3a7f041-c99d-4304-a6fb-078ea3929dcb req-0b5ea701-2c90-45de-bfb1-f040055fb0e2 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Received event network-vif-plugged-014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b3a7f041-c99d-4304-a6fb-078ea3929dcb req-0b5ea701-2c90-45de-bfb1-f040055fb0e2 service nova] Acquiring lock "9a381085-5df7-453e-8631-995ab647cabe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b3a7f041-c99d-4304-a6fb-078ea3929dcb req-0b5ea701-2c90-45de-bfb1-f040055fb0e2 service nova] Lock "9a381085-5df7-453e-8631-995ab647cabe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b3a7f041-c99d-4304-a6fb-078ea3929dcb req-0b5ea701-2c90-45de-bfb1-f040055fb0e2 service nova] Lock "9a381085-5df7-453e-8631-995ab647cabe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-b3a7f041-c99d-4304-a6fb-078ea3929dcb req-0b5ea701-2c90-45de-bfb1-f040055fb0e2 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] No waiting events found dispatching network-vif-plugged-014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:11 user nova-compute[72426]: WARNING nova.compute.manager [req-b3a7f041-c99d-4304-a6fb-078ea3929dcb req-0b5ea701-2c90-45de-bfb1-f040055fb0e2 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Received unexpected event network-vif-plugged-014c7d18-8891-4ef4-af3e-72c15509fd5f for instance with vm_state building and task_state spawning.
Aug 01 08:26:11 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:26:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk /opt/stack/data/nova/instances/snapshots/tmp23mcawgb/056e2e1cdf4e498989b8e2e53e9718c6 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk /opt/stack/data/nova/instances/snapshots/tmp23mcawgb/056e2e1cdf4e498989b8e2e53e9718c6" returned: 0 in 0.651s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:11 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Snapshot extracted, beginning image upload
Aug 01 08:26:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-d9a7efee-7fe4-4d65-a07e-42da590b9e9a req-78cca8f2-420e-405b-aa7a-b172ac9866b9 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9a7efee-7fe4-4d65-a07e-42da590b9e9a req-78cca8f2-420e-405b-aa7a-b172ac9866b9 service nova] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9a7efee-7fe4-4d65-a07e-42da590b9e9a req-78cca8f2-420e-405b-aa7a-b172ac9866b9 service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d9a7efee-7fe4-4d65-a07e-42da590b9e9a req-78cca8f2-420e-405b-aa7a-b172ac9866b9 service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-d9a7efee-7fe4-4d65-a07e-42da590b9e9a req-78cca8f2-420e-405b-aa7a-b172ac9866b9 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] No waiting events found dispatching network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:12 user nova-compute[72426]: WARNING nova.compute.manager [req-d9a7efee-7fe4-4d65-a07e-42da590b9e9a req-78cca8f2-420e-405b-aa7a-b172ac9866b9 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received unexpected event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 08:26:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:13 user nova-compute[72426]: INFO nova.compute.manager [None req-a1cc0aa5-8046-4cb7-85c7-9f4aedd53c89 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Unrescuing
Aug 01 08:26:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a1cc0aa5-8046-4cb7-85c7-9f4aedd53c89 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a1cc0aa5-8046-4cb7-85c7-9f4aedd53c89 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquired lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a1cc0aa5-8046-4cb7-85c7-9f4aedd53c89 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-2352e1bf-2408-4690-9b94-35489c340f52 req-943cbc1b-c528-4195-933f-2a8c470e657f service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Received event network-vif-plugged-014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2352e1bf-2408-4690-9b94-35489c340f52 req-943cbc1b-c528-4195-933f-2a8c470e657f service nova] Acquiring lock "9a381085-5df7-453e-8631-995ab647cabe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2352e1bf-2408-4690-9b94-35489c340f52 req-943cbc1b-c528-4195-933f-2a8c470e657f service nova] Lock "9a381085-5df7-453e-8631-995ab647cabe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2352e1bf-2408-4690-9b94-35489c340f52 req-943cbc1b-c528-4195-933f-2a8c470e657f service nova] Lock "9a381085-5df7-453e-8631-995ab647cabe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-2352e1bf-2408-4690-9b94-35489c340f52 req-943cbc1b-c528-4195-933f-2a8c470e657f service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] No waiting events found dispatching network-vif-plugged-014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:13 user nova-compute[72426]: WARNING nova.compute.manager [req-2352e1bf-2408-4690-9b94-35489c340f52 req-943cbc1b-c528-4195-933f-2a8c470e657f service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Received unexpected event network-vif-plugged-014c7d18-8891-4ef4-af3e-72c15509fd5f for instance with vm_state building and task_state spawning.
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878373.396647, 9a381085-5df7-453e-8631-995ab647cabe => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9a381085-5df7-453e-8631-995ab647cabe] VM Resumed (Lifecycle Event)
Aug 01 08:26:13 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Instance spawned successfully.
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:26:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9a381085-5df7-453e-8631-995ab647cabe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878373.3968103, 9a381085-5df7-453e-8631-995ab647cabe => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9a381085-5df7-453e-8631-995ab647cabe] VM Started (Lifecycle Event)
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:26:13 user nova-compute[72426]: INFO nova.compute.manager [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Took 6.67 seconds to spawn the instance on the hypervisor.
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 9a381085-5df7-453e-8631-995ab647cabe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:26:13 user nova-compute[72426]: INFO nova.compute.manager [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Took 7.56 seconds to build instance.
Aug 01 08:26:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3fe76b57-72ad-4873-9648-afab289a4732 tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "9a381085-5df7-453e-8631-995ab647cabe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.676s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a1cc0aa5-8046-4cb7-85c7-9f4aedd53c89 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating instance_info_cache with network_info: [{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a1cc0aa5-8046-4cb7-85c7-9f4aedd53c89 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Releasing lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG nova.objects.instance [None req-a1cc0aa5-8046-4cb7-85c7-9f4aedd53c89 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'flavor' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-1df97e29-8b18-4193-adad-c07c55931879 req-7ce4a12f-74b8-4725-9283-4d6a69d221fb service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-unplugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1df97e29-8b18-4193-adad-c07c55931879 req-7ce4a12f-74b8-4725-9283-4d6a69d221fb service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1df97e29-8b18-4193-adad-c07c55931879 req-7ce4a12f-74b8-4725-9283-4d6a69d221fb service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1df97e29-8b18-4193-adad-c07c55931879 req-7ce4a12f-74b8-4725-9283-4d6a69d221fb service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:14 user nova-compute[72426]: DEBUG nova.compute.manager [req-1df97e29-8b18-4193-adad-c07c55931879 req-7ce4a12f-74b8-4725-9283-4d6a69d221fb service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-unplugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:14 user nova-compute[72426]: WARNING nova.compute.manager [req-1df97e29-8b18-4193-adad-c07c55931879 req-7ce4a12f-74b8-4725-9283-4d6a69d221fb service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-unplugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:26:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Instance destroyed successfully.
Aug 01 08:26:15 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Snapshot image upload complete
Aug 01 08:26:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:15 user nova-compute[72426]: INFO nova.compute.manager [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Shelve offloading
Aug 01 08:26:15 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Instance destroyed successfully.
Aug 01 08:26:15 user nova-compute[72426]: DEBUG nova.compute.manager [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:26:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquired lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:26:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:26:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updating instance_info_cache with network_info: [{"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Releasing lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:26:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:16 user nova-compute[72426]: WARNING nova.compute.manager [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:16 user nova-compute[72426]: WARNING nova.compute.manager [req-59271216-a373-4657-9aa3-a1fcff6b7b20 req-d3c4324a-ed65-49e7-96d2-09a93b8923a5 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state rescued and task_state unrescuing.
Aug 01 08:26:16 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Instance destroyed successfully.
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.objects.instance [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'resources' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-516ba64c-a9e1-4fee-a826-4989f4c367fd req-65cff45a-0568-4a4f-ab2d-b4033edf5902 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-changed-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-516ba64c-a9e1-4fee-a826-4989f4c367fd req-65cff45a-0568-4a4f-ab2d-b4033edf5902 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Refreshing instance network info cache due to event network-changed-f2a59028-82a7-4744-82f8-b9b0ec197596. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-516ba64c-a9e1-4fee-a826-4989f4c367fd req-65cff45a-0568-4a4f-ab2d-b4033edf5902 service nova] Acquiring lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-516ba64c-a9e1-4fee-a826-4989f4c367fd req-65cff45a-0568-4a4f-ab2d-b4033edf5902 service nova] Acquired lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.network.neutron [req-516ba64c-a9e1-4fee-a826-4989f4c367fd req-65cff45a-0568-4a4f-ab2d-b4033edf5902 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Refreshing network info cache for port f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-346930247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-346930247',id=36,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOGJcD/bVQDB9UNIgYrZutvKusV64+EQs5MwRC0T3lUQ7Jba0bJ64Nnjdplr37shpC+G0dU9qi9dzjyF5eRM5Lpu8dfSmVg0g6OpDbBLWTgKqBw3s/M6sdjqtKs5hOYow==',key_name='tempest-keypair-1856498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-08m57t5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member',shelved_at='2023-08-01T08:26:15.027023',shelved_host='user',shelved_image_id='626ce0eb-0b53-4a9c-bec8-f21755becccd'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:26:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=468edb40-0972-4589-9395-826c1eeb0dc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG os_vif [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2a59028-82, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:26:16 user nova-compute[72426]: INFO os_vif [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82')
Aug 01 08:26:16 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Deleting instance files /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6_del
Aug 01 08:26:16 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Deletion of /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6_del complete
Aug 01 08:26:16 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Deleted allocations for instance 468edb40-0972-4589-9395-826c1eeb0dc6
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.objects.instance [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'numa_topology' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.network.neutron [req-516ba64c-a9e1-4fee-a826-4989f4c367fd req-65cff45a-0568-4a4f-ab2d-b4033edf5902 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updated VIF entry in instance network info cache for port f2a59028-82a7-4744-82f8-b9b0ec197596. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG nova.network.neutron [req-516ba64c-a9e1-4fee-a826-4989f4c367fd req-65cff45a-0568-4a4f-ab2d-b4033edf5902 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updating instance_info_cache with network_info: [{"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf2a59028-82", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-516ba64c-a9e1-4fee-a826-4989f4c367fd req-65cff45a-0568-4a4f-ab2d-b4033edf5902 service nova] Releasing lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:26:17 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:26:17 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:26:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7d1ccab4-1c47-4c3c-bf72-f689fcee12fc tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "468edb40-0972-4589-9395-826c1eeb0dc6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.560s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Removed pending event for c707f931-d77d-44c8-a352-49e673ff6c0b due to event {{(pid=72426) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878378.1880713, c707f931-d77d-44c8-a352-49e673ff6c0b => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:18 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] VM Resumed (Lifecycle Event)
Aug 01 08:26:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a1cc0aa5-8046-4cb7-85c7-9f4aedd53c89 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878378.1899192, c707f931-d77d-44c8-a352-49e673ff6c0b => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:18 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] VM Started (Lifecycle Event)
Aug 01 08:26:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-acb34d6d-ee08-4baa-b4e9-cab634e7fd12 req-4bb7ec13-d6be-4182-a943-dc1a2bfd37b2 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb34d6d-ee08-4baa-b4e9-cab634e7fd12 req-4bb7ec13-d6be-4182-a943-dc1a2bfd37b2 service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb34d6d-ee08-4baa-b4e9-cab634e7fd12 req-4bb7ec13-d6be-4182-a943-dc1a2bfd37b2 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-acb34d6d-ee08-4baa-b4e9-cab634e7fd12 req-4bb7ec13-d6be-4182-a943-dc1a2bfd37b2 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-acb34d6d-ee08-4baa-b4e9-cab634e7fd12 req-4bb7ec13-d6be-4182-a943-dc1a2bfd37b2 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:18 user nova-compute[72426]: WARNING nova.compute.manager [req-acb34d6d-ee08-4baa-b4e9-cab634e7fd12 req-4bb7ec13-d6be-4182-a943-dc1a2bfd37b2 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state active and task_state None.
Aug 01 08:26:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:25 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878370.9512236, 468edb40-0972-4589-9395-826c1eeb0dc6 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:25 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] VM Stopped (Lifecycle Event)
Aug 01 08:26:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-db973592-e049-4e31-86d9-f420c6cfd920 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:26:30 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:34 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:26:34 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:26:34 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7045MB free_disk=24.935882568359375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:26:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 73fb06b8-0824-42fc-bbfd-6914bdb78824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance e1119088-18c7-483d-a89d-3b5d19054e52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 37dab412-5a15-46e8-844e-2ef0c03b7181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c707f931-d77d-44c8-a352-49e673ff6c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 8fff7c8e-8129-40f3-ac3b-9b60408705ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 1fc3bc29-8fc0-41ee-b54c-90d960996c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 9a381085-5df7-453e-8631-995ab647cabe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "73fb06b8-0824-42fc-bbfd-6914bdb78824" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:35 user nova-compute[72426]: INFO nova.compute.manager [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Terminating instance
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-007c30ca-ee73-4b7e-8e87-1ac4a33bda60 req-aa44187b-e075-4545-8626-da5feef6ef51 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Received event network-vif-unplugged-993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-007c30ca-ee73-4b7e-8e87-1ac4a33bda60 req-aa44187b-e075-4545-8626-da5feef6ef51 service nova] Acquiring lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-007c30ca-ee73-4b7e-8e87-1ac4a33bda60 req-aa44187b-e075-4545-8626-da5feef6ef51 service nova] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-007c30ca-ee73-4b7e-8e87-1ac4a33bda60 req-aa44187b-e075-4545-8626-da5feef6ef51 service nova] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-007c30ca-ee73-4b7e-8e87-1ac4a33bda60 req-aa44187b-e075-4545-8626-da5feef6ef51 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] No waiting events found dispatching network-vif-unplugged-993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG nova.compute.manager [req-007c30ca-ee73-4b7e-8e87-1ac4a33bda60 req-aa44187b-e075-4545-8626-da5feef6ef51 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Received event network-vif-unplugged-993dc5e4-241f-4058-9dca-58a406286d19 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Instance destroyed successfully.
Aug 01 08:26:36 user nova-compute[72426]: DEBUG nova.objects.instance [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'resources' on Instance uuid 73fb06b8-0824-42fc-bbfd-6914bdb78824 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1755267583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1755267583',id=24,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-yumkhyg7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:19:09Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=73fb06b8-0824-42fc-bbfd-6914bdb78824,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "993dc5e4-241f-4058-9dca-58a406286d19", "address": "fa:16:3e:68:9c:0b", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993dc5e4-24", "ovs_interfaceid": "993dc5e4-241f-4058-9dca-58a406286d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "993dc5e4-241f-4058-9dca-58a406286d19", "address": "fa:16:3e:68:9c:0b", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993dc5e4-24", "ovs_interfaceid": "993dc5e4-241f-4058-9dca-58a406286d19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=993dc5e4-241f-4058-9dca-58a406286d19,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993dc5e4-24') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG os_vif [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=993dc5e4-241f-4058-9dca-58a406286d19,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993dc5e4-24') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap993dc5e4-24, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:36 user nova-compute[72426]: INFO os_vif [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=993dc5e4-241f-4058-9dca-58a406286d19,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993dc5e4-24')
Aug 01 08:26:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Deleting instance files /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824_del
Aug 01 08:26:36 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Deletion of /opt/stack/data/nova/instances/73fb06b8-0824-42fc-bbfd-6914bdb78824_del complete
Aug 01 08:26:36 user nova-compute[72426]: INFO nova.compute.manager [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 08:26:36 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:26:36 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:36 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Took 0.60 seconds to deallocate network for instance.
Aug 01 08:26:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-0e3c9241-cdcf-4c95-96d9-58a6f7e36281 req-0a098d44-2d1d-4e70-aa38-b4fed6be11fb service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Received event network-vif-deleted-993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:37 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Deleted allocations for instance 73fb06b8-0824-42fc-bbfd-6914bdb78824
Aug 01 08:26:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4114fea4-92d9-4cec-a8b5-0541f7e0b956 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG nova.compute.manager [req-89352d1e-cdef-4379-86f9-70771a4fa031 req-195e5617-b419-4b15-a054-0fac78d38677 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Received event network-vif-plugged-993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-89352d1e-cdef-4379-86f9-70771a4fa031 req-195e5617-b419-4b15-a054-0fac78d38677 service nova] Acquiring lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-89352d1e-cdef-4379-86f9-70771a4fa031 req-195e5617-b419-4b15-a054-0fac78d38677 service nova] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-89352d1e-cdef-4379-86f9-70771a4fa031 req-195e5617-b419-4b15-a054-0fac78d38677 service nova] Lock "73fb06b8-0824-42fc-bbfd-6914bdb78824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:37 user nova-compute[72426]: DEBUG nova.compute.manager [req-89352d1e-cdef-4379-86f9-70771a4fa031 req-195e5617-b419-4b15-a054-0fac78d38677 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] No waiting events found dispatching network-vif-plugged-993dc5e4-241f-4058-9dca-58a406286d19 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:37 user nova-compute[72426]: WARNING nova.compute.manager [req-89352d1e-cdef-4379-86f9-70771a4fa031 req-195e5617-b419-4b15-a054-0fac78d38677 service nova] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Received unexpected event network-vif-plugged-993dc5e4-241f-4058-9dca-58a406286d19 for instance with vm_state deleted and task_state None.
Aug 01 08:26:39 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:26:39 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:26:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:26:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:26:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:26:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:26:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Updating instance_info_cache with network_info: [{"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-bbb82852-01b7-4609-95a3-f8f36cebbf7d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:26:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:26:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:26:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:26:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:26:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:26:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:26:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-67fd7bf6-3caa-4ff8-aa93-9f511d40dbdf req-1204d51f-d292-403f-94bf-018267513ba3 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received event network-changed-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:44 user nova-compute[72426]: DEBUG nova.compute.manager [req-67fd7bf6-3caa-4ff8-aa93-9f511d40dbdf req-1204d51f-d292-403f-94bf-018267513ba3 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Refreshing instance network info cache due to event network-changed-550346c3-b6a2-4aec-a520-93f161d77018. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:26:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-67fd7bf6-3caa-4ff8-aa93-9f511d40dbdf req-1204d51f-d292-403f-94bf-018267513ba3 service nova] Acquiring lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:26:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-67fd7bf6-3caa-4ff8-aa93-9f511d40dbdf req-1204d51f-d292-403f-94bf-018267513ba3 service nova] Acquired lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:26:44 user nova-compute[72426]: DEBUG nova.network.neutron [req-67fd7bf6-3caa-4ff8-aa93-9f511d40dbdf req-1204d51f-d292-403f-94bf-018267513ba3 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Refreshing network info cache for port 550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:26:44 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:26:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:44 user nova-compute[72426]: DEBUG nova.objects.instance [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'flavor' on Instance uuid 1fc3bc29-8fc0-41ee-b54c-90d960996c41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:26:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:45 user nova-compute[72426]: INFO nova.compute.manager [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Attaching volume 03d08421-314e-4e10-a4af-342c1afefcb8 to /dev/vdb
Aug 01 08:26:45 user nova-compute[72426]: DEBUG os_brick.utils [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aed666-40ba-4ddf-a574-e76e1708e0e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb1d105-e7fc-4cbd-9978-42c3bca4d180]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0b24cb-29bc-4529-8c4b-b817600be01f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6dec5c-c283-4309-8cd3-24015558cd4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:26:45 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e085c076-d252-4122-b7ea-99ced1e1175c]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG os_brick.utils [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Updating existing volume attachment record: c20ec9df-3ecd-4f25-a999-8a2073c46699 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG nova.network.neutron [req-67fd7bf6-3caa-4ff8-aa93-9f511d40dbdf req-1204d51f-d292-403f-94bf-018267513ba3 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Updated VIF entry in instance network info cache for port 550346c3-b6a2-4aec-a520-93f161d77018. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG nova.network.neutron [req-67fd7bf6-3caa-4ff8-aa93-9f511d40dbdf req-1204d51f-d292-403f-94bf-018267513ba3 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Updating instance_info_cache with network_info: [{"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-67fd7bf6-3caa-4ff8-aa93-9f511d40dbdf req-1204d51f-d292-403f-94bf-018267513ba3 service nova] Releasing lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:26:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:26:47 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:26:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:26:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:47 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:26:47 user nova-compute[72426]: INFO nova.compute.claims [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Claim successful on node user
Aug 01 08:26:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:47 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:26:47 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:26:48 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.policy [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2db17ac7e6544b69fdffa7200b18d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68df7fb0822470ea6cf897d2987db57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:26:48 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Creating image(s)
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "/opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "/opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "/opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk 1073741824" returned: 0 in 0.057s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Cannot resize image /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.objects.instance [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lazy-loading 'migration_context' on Instance uuid 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Ensure instance console log exists: /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:48 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Successfully created port: 8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:26:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Successfully updated port: 8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:26:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "refresh_cache-46dc65bb-be41-48c9-9ffe-513d60afa9c0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:26:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquired lock "refresh_cache-46dc65bb-be41-48c9-9ffe-513d60afa9c0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:26:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:26:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-031e81ef-a5f0-4915-a7df-66b6196a7e2a req-f1d0ad58-ec91-4793-a5e4-00f774ce5667 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received event network-changed-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-031e81ef-a5f0-4915-a7df-66b6196a7e2a req-f1d0ad58-ec91-4793-a5e4-00f774ce5667 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Refreshing instance network info cache due to event network-changed-8c6e8110-5538-45f1-84f0-ad575bd36538. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:26:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-031e81ef-a5f0-4915-a7df-66b6196a7e2a req-f1d0ad58-ec91-4793-a5e4-00f774ce5667 service nova] Acquiring lock "refresh_cache-46dc65bb-be41-48c9-9ffe-513d60afa9c0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:26:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.network.neutron [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Updating instance_info_cache with network_info: [{"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Releasing lock "refresh_cache-46dc65bb-be41-48c9-9ffe-513d60afa9c0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Instance network_info: |[{"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-031e81ef-a5f0-4915-a7df-66b6196a7e2a req-f1d0ad58-ec91-4793-a5e4-00f774ce5667 service nova] Acquired lock "refresh_cache-46dc65bb-be41-48c9-9ffe-513d60afa9c0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-031e81ef-a5f0-4915-a7df-66b6196a7e2a req-f1d0ad58-ec91-4793-a5e4-00f774ce5667 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Refreshing network info cache for port 8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Start _get_guest_xml network_info=[{"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:26:50 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:26:50 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-649723227',display_name='tempest-TestServerVolumeAttachmentScenario-server-649723227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-649723227',id=40,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+hvrYFTZrYcj1ZMf/GuxMu3v7EY7XX08KPsJVT6w+xeq+Zu6gfrgZdRK1wW78RsS5SHC92HMw3gBL62qzpYc/E48ZtuCjAiKO3KiAs1C/83DDDhBmpX2R1Rhvs/q94wg==',key_name='tempest-keypair-827698336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d68df7fb0822470ea6cf897d2987db57',ramdisk_id='',reservation_id='r-3zjpripi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-914153557',owner_user_name='tempest-TestServerVolumeAttachmentScenario-914153557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:26:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2db17ac7e6544b69fdffa7200b18d17',uuid=46dc65bb-be41-48c9-9ffe-513d60afa9c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Converting VIF {"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bd:41,bridge_name='br-int',has_traffic_filtering=True,id=8c6e8110-5538-45f1-84f0-ad575bd36538,network=Network(eec61d64-59a5-4200-92b9-1a4c061d532a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6e8110-55') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.objects.instance [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lazy-loading 'pci_devices' on Instance uuid 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:26:50 user nova-compute[72426]:   <uuid>46dc65bb-be41-48c9-9ffe-513d60afa9c0</uuid>
Aug 01 08:26:50 user nova-compute[72426]:   <name>instance-00000028</name>
Aug 01 08:26:50 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:26:50 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:26:50 user nova-compute[72426]:   <metadata>
Aug 01 08:26:50 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:26:50 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:26:50 user nova-compute[72426]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-649723227</nova:name>
Aug 01 08:26:50 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:26:50</nova:creationTime>
Aug 01 08:26:50 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:26:50 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:26:50 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:26:50 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:26:50 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:26:50 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:26:50 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:26:50 user nova-compute[72426]:       <nova:owner>
Aug 01 08:26:50 user nova-compute[72426]:         <nova:user uuid="a2db17ac7e6544b69fdffa7200b18d17">tempest-TestServerVolumeAttachmentScenario-914153557-project-member</nova:user>
Aug 01 08:26:50 user nova-compute[72426]:         <nova:project uuid="d68df7fb0822470ea6cf897d2987db57">tempest-TestServerVolumeAttachmentScenario-914153557</nova:project>
Aug 01 08:26:50 user nova-compute[72426]:       </nova:owner>
Aug 01 08:26:50 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:26:50 user nova-compute[72426]:       <nova:ports>
Aug 01 08:26:50 user nova-compute[72426]:         <nova:port uuid="8c6e8110-5538-45f1-84f0-ad575bd36538">
Aug 01 08:26:50 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 08:26:50 user nova-compute[72426]:         </nova:port>
Aug 01 08:26:50 user nova-compute[72426]:       </nova:ports>
Aug 01 08:26:50 user nova-compute[72426]:     </nova:instance>
Aug 01 08:26:50 user nova-compute[72426]:   </metadata>
Aug 01 08:26:50 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:26:50 user nova-compute[72426]:     <system>
Aug 01 08:26:50 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:26:50 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:26:50 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:26:50 user nova-compute[72426]:       <entry name="serial">46dc65bb-be41-48c9-9ffe-513d60afa9c0</entry>
Aug 01 08:26:50 user nova-compute[72426]:       <entry name="uuid">46dc65bb-be41-48c9-9ffe-513d60afa9c0</entry>
Aug 01 08:26:50 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:26:50 user nova-compute[72426]:     </system>
Aug 01 08:26:50 user nova-compute[72426]:   </sysinfo>
Aug 01 08:26:50 user nova-compute[72426]:   <os>
Aug 01 08:26:50 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:26:50 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:26:50 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:26:50 user nova-compute[72426]:   </os>
Aug 01 08:26:50 user nova-compute[72426]:   <features>
Aug 01 08:26:50 user nova-compute[72426]:     <acpi/>
Aug 01 08:26:50 user nova-compute[72426]:     <apic/>
Aug 01 08:26:50 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:26:50 user nova-compute[72426]:   </features>
Aug 01 08:26:50 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:26:50 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:26:50 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:26:50 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:26:50 user nova-compute[72426]:   </clock>
Aug 01 08:26:50 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:26:50 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:26:50 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:26:50 user nova-compute[72426]:   </cpu>
Aug 01 08:26:50 user nova-compute[72426]:   <devices>
Aug 01 08:26:50 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:26:50 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:26:50 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk"/>
Aug 01 08:26:50 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:26:50 user nova-compute[72426]:     </disk>
Aug 01 08:26:50 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:26:50 user nova-compute[72426]:       <mac address="fa:16:3e:d1:bd:41"/>
Aug 01 08:26:50 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:26:50 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:26:50 user nova-compute[72426]:       <target dev="tap8c6e8110-55"/>
Aug 01 08:26:50 user nova-compute[72426]:     </interface>
Aug 01 08:26:50 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:26:50 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/console.log" append="off"/>
Aug 01 08:26:50 user nova-compute[72426]:     </serial>
Aug 01 08:26:50 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:26:50 user nova-compute[72426]:     <video>
Aug 01 08:26:50 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:26:50 user nova-compute[72426]:     </video>
Aug 01 08:26:50 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:26:50 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:26:50 user nova-compute[72426]:     </rng>
Aug 01 08:26:50 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:26:50 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:26:50 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:26:50 user nova-compute[72426]:     </memballoon>
Aug 01 08:26:50 user nova-compute[72426]:   </devices>
Aug 01 08:26:50 user nova-compute[72426]: </domain>
Aug 01 08:26:50 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-649723227',display_name='tempest-TestServerVolumeAttachmentScenario-server-649723227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-649723227',id=40,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+hvrYFTZrYcj1ZMf/GuxMu3v7EY7XX08KPsJVT6w+xeq+Zu6gfrgZdRK1wW78RsS5SHC92HMw3gBL62qzpYc/E48ZtuCjAiKO3KiAs1C/83DDDhBmpX2R1Rhvs/q94wg==',key_name='tempest-keypair-827698336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d68df7fb0822470ea6cf897d2987db57',ramdisk_id='',reservation_id='r-3zjpripi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-914153557',owner_user_name='tempest-TestServerVolumeAttachmentScenario-914153557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:26:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2db17ac7e6544b69fdffa7200b18d17',uuid=46dc65bb-be41-48c9-9ffe-513d60afa9c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Converting VIF {"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bd:41,bridge_name='br-int',has_traffic_filtering=True,id=8c6e8110-5538-45f1-84f0-ad575bd36538,network=Network(eec61d64-59a5-4200-92b9-1a4c061d532a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6e8110-55') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG os_vif [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bd:41,bridge_name='br-int',has_traffic_filtering=True,id=8c6e8110-5538-45f1-84f0-ad575bd36538,network=Network(eec61d64-59a5-4200-92b9-1a4c061d532a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6e8110-55') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c6e8110-55, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c6e8110-55, col_values=(('external_ids', {'iface-id': '8c6e8110-5538-45f1-84f0-ad575bd36538', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:bd:41', 'vm-uuid': '46dc65bb-be41-48c9-9ffe-513d60afa9c0'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:50 user nova-compute[72426]: INFO os_vif [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bd:41,bridge_name='br-int',has_traffic_filtering=True,id=8c6e8110-5538-45f1-84f0-ad575bd36538,network=Network(eec61d64-59a5-4200-92b9-1a4c061d532a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6e8110-55')
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] No VIF found with MAC fa:16:3e:d1:bd:41, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-031e81ef-a5f0-4915-a7df-66b6196a7e2a req-f1d0ad58-ec91-4793-a5e4-00f774ce5667 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Updated VIF entry in instance network info cache for port 8c6e8110-5538-45f1-84f0-ad575bd36538. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-031e81ef-a5f0-4915-a7df-66b6196a7e2a req-f1d0ad58-ec91-4793-a5e4-00f774ce5667 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Updating instance_info_cache with network_info: [{"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:26:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-031e81ef-a5f0-4915-a7df-66b6196a7e2a req-f1d0ad58-ec91-4793-a5e4-00f774ce5667 service nova] Releasing lock "refresh_cache-46dc65bb-be41-48c9-9ffe-513d60afa9c0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:26:51 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878396.262169, 73fb06b8-0824-42fc-bbfd-6914bdb78824 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:51 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] VM Stopped (Lifecycle Event)
Aug 01 08:26:51 user nova-compute[72426]: DEBUG nova.compute.manager [None req-8f80d59f-55a5-4531-b2e0-93a6036a4361 None None] [instance: 73fb06b8-0824-42fc-bbfd-6914bdb78824] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-610eb92a-ce3b-4818-a780-e9a949033f97 req-61b4eaa1-2910-4747-bcc8-9ed12011cf4a service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received event network-vif-plugged-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-610eb92a-ce3b-4818-a780-e9a949033f97 req-61b4eaa1-2910-4747-bcc8-9ed12011cf4a service nova] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-610eb92a-ce3b-4818-a780-e9a949033f97 req-61b4eaa1-2910-4747-bcc8-9ed12011cf4a service nova] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-610eb92a-ce3b-4818-a780-e9a949033f97 req-61b4eaa1-2910-4747-bcc8-9ed12011cf4a service nova] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-610eb92a-ce3b-4818-a780-e9a949033f97 req-61b4eaa1-2910-4747-bcc8-9ed12011cf4a service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] No waiting events found dispatching network-vif-plugged-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:51 user nova-compute[72426]: WARNING nova.compute.manager [req-610eb92a-ce3b-4818-a780-e9a949033f97 req-61b4eaa1-2910-4747-bcc8-9ed12011cf4a service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received unexpected event network-vif-plugged-8c6e8110-5538-45f1-84f0-ad575bd36538 for instance with vm_state building and task_state spawning.
Aug 01 08:26:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-e6595014-4d58-45e0-a498-ab7c5701b1a5 req-03fca60e-60ff-44d1-80c2-27c0e1804f99 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received event network-vif-plugged-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e6595014-4d58-45e0-a498-ab7c5701b1a5 req-03fca60e-60ff-44d1-80c2-27c0e1804f99 service nova] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e6595014-4d58-45e0-a498-ab7c5701b1a5 req-03fca60e-60ff-44d1-80c2-27c0e1804f99 service nova] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e6595014-4d58-45e0-a498-ab7c5701b1a5 req-03fca60e-60ff-44d1-80c2-27c0e1804f99 service nova] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-e6595014-4d58-45e0-a498-ab7c5701b1a5 req-03fca60e-60ff-44d1-80c2-27c0e1804f99 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] No waiting events found dispatching network-vif-plugged-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:26:54 user nova-compute[72426]: WARNING nova.compute.manager [req-e6595014-4d58-45e0-a498-ab7c5701b1a5 req-03fca60e-60ff-44d1-80c2-27c0e1804f99 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received unexpected event network-vif-plugged-8c6e8110-5538-45f1-84f0-ad575bd36538 for instance with vm_state building and task_state spawning.
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878414.0665972, 46dc65bb-be41-48c9-9ffe-513d60afa9c0 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:54 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] VM Resumed (Lifecycle Event)
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:26:54 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Instance spawned successfully.
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THaQIrlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:26:54 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:26:54 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:26:54 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:26:54 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878414.0685048, 46dc65bb-be41-48c9-9ffe-513d60afa9c0 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:26:54 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] VM Started (Lifecycle Event)
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5f44bc-da9e-43a4-84b1-d1a3e4d7d870]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:26:54 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b89c88-324b-4782-872b-a48dca93742d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8] added
Aug 01 08:26:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.113s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cb4ff7-020e-4765-8eff-0068f4c5d633]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: INFO nova.compute.manager [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Took 6.05 seconds to spawn the instance on the hypervisor.
Aug 01 08:26:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a151992c-cd5c-4422-b6c1-d201b7755ba0]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THaQIrlW {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THaQIrlW" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[27de3fa8-7b03-4002-9864-bb37dc6e166f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THaQIrlW'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad82653-5624-4304-b517-9dd087489309]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ad4e86-aa3e-425e-ac6e-ff06b4e11944]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:26:54 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:26:54 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:26:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:26:54 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:26:54 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:26:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: INFO nova.compute.manager [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Took 6.90 seconds to build instance.
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a233a8d4-9e0f-42ac-a57c-950b85c9f18b tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.031s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[09de4160-9f36-414f-b1d7-94060252aa1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8, portal: 172.16.0.220,3260]
Aug 01 08:26:54 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8, portal: 172.16.0.220,3260] successful.
Aug 01 08:26:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[00249a79-6782-4e2b-a2b7-7937b8fbc6a0]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b2547-96da-4d74-831e-207c9a702e8d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:26:54 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:26:54 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:26:54 user nova-compute[72426]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 (non-flash)
Aug 01 08:26:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:26:54 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:26:54 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:26:54 user nova-compute[72426]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 (non-flash)
Aug 01 08:26:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc8c58-a324-42cc-a09d-c013fffd5b8d]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:26:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THaQIrlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:26:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:26:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23963313530323663', 'path': '/dev/sde'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:26:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963313530323663', 'path': '/dev/sde'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:26:55 user nova-compute[72426]: DEBUG nova.objects.instance [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'flavor' on Instance uuid 1fc3bc29-8fc0-41ee-b54c-90d960996c41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:26:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:26:55 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:26:55 user nova-compute[72426]:   <source dev="/dev/sde"/>
Aug 01 08:26:55 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:26:55 user nova-compute[72426]:   <serial>03d08421-314e-4e10-a4af-342c1afefcb8</serial>
Aug 01 08:26:55 user nova-compute[72426]: </disk>
Aug 01 08:26:55 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:26:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:26:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:26:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] No VIF found with MAC fa:16:3e:d7:0b:8b, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:26:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c56d60b4-6946-4d71-a3c0-7dc7e6f998b9 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.150s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:26:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:26:58 user nova-compute[72426]: INFO nova.compute.manager [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Detaching volume 03d08421-314e-4e10-a4af-342c1afefcb8
Aug 01 08:26:58 user nova-compute[72426]: INFO nova.virt.block_device [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Attempting to driver detach volume 03d08421-314e-4e10-a4af-342c1afefcb8 from mountpoint /dev/vdb
Aug 01 08:26:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Attempting to detach device vdb from instance 1fc3bc29-8fc0-41ee-b54c-90d960996c41 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:26:58 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:26:58 user nova-compute[72426]:   <source dev="/dev/sde"/>
Aug 01 08:26:58 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:26:58 user nova-compute[72426]:   <serial>03d08421-314e-4e10-a4af-342c1afefcb8</serial>
Aug 01 08:26:58 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:26:58 user nova-compute[72426]: </disk>
Aug 01 08:26:58 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:26:58 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Successfully detached device vdb from instance 1fc3bc29-8fc0-41ee-b54c-90d960996c41 from the persistent domain config.
Aug 01 08:26:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1fc3bc29-8fc0-41ee-b54c-90d960996c41 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:26:58 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:26:58 user nova-compute[72426]:   <source dev="/dev/sde"/>
Aug 01 08:26:58 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:26:58 user nova-compute[72426]:   <serial>03d08421-314e-4e10-a4af-342c1afefcb8</serial>
Aug 01 08:26:58 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:26:58 user nova-compute[72426]: </disk>
Aug 01 08:26:58 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878418.7180023, 1fc3bc29-8fc0-41ee-b54c-90d960996c41 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1fc3bc29-8fc0-41ee-b54c-90d960996c41 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:26:58 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Successfully detached device vdb from instance 1fc3bc29-8fc0-41ee-b54c-90d960996c41 from the live domain config.
Aug 01 08:26:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THaQIrlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:26:58 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1110926-c6f2-403c-8def-9b4f8ebf9492]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[38374f35-7a26-4379-be8a-23a123592661]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:26:58 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:26:58 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:26:58 user nova-compute[72426]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 (non-flash)
Aug 01 08:26:58 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:26:58 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:26:58 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:26:58 user nova-compute[72426]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 (non-flash)
Aug 01 08:26:58 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38e6d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8'): ({'sde'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Removing single pathed devices sde {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[660777a3-6139-4413-915f-e9869e94eb61]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7944c22-1673-4d63-8845-48ecd47d93b2]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Flushing IO for device /dev/sde {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0af341-aa15-485f-b1c6-8ecb1ce40700]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f61014-8c06-4c14-a0d1-6ecba080b784]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] SCSI volumes sde have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c306c66-d575-4207-85f6-29d97efdb08d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[048a1cfc-b920-4555-9cd1-9603a4cd74c2]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8, portal: 172.16.0.220,3260]
Aug 01 08:26:58 user nova-compute[72426]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8, portal: 172.16.0.220,3260] successful.
Aug 01 08:26:58 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:26:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03d08421-314e-4e10-a4af-342c1afefcb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:26:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[76523a79-c07b-420e-ab21-dc7236ef2e24]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:26:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:26:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:26:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] <== disconnect_volume: return (294ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:26:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:26:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:00 user nova-compute[72426]: DEBUG nova.objects.instance [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'flavor' on Instance uuid 1fc3bc29-8fc0-41ee-b54c-90d960996c41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:27:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-14778b54-12c4-445e-8754-4b72bf381e47 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.154s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:00 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "1307ee99-42c0-4086-b8b1-120630450f5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:05 user nova-compute[72426]: DEBUG nova.compute.manager [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:27:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:05 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:27:05 user nova-compute[72426]: INFO nova.compute.claims [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Claim successful on node user
Aug 01 08:27:06 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG nova.network.neutron [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:27:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:27:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG nova.policy [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53c85b986ed140c491cd0ed264e561c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d23fc511343c698af4392fc3de94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:27:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Creating image(s)
Aug 01 08:27:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "/opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "/opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "/opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk 1073741824" returned: 0 in 0.054s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG nova.network.neutron [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Successfully created port: 0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Cannot resize image /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG nova.objects.instance [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'migration_context' on Instance uuid 1307ee99-42c0-4086-b8b1-120630450f5c {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Ensure instance console log exists: /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.neutron [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Successfully updated port: 0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquired lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.neutron [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-fb3e46d2-4af7-4bd3-8703-5dad0d48ccb6 req-b391991a-33d5-4166-942d-d817d3b6e8d4 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received event network-changed-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-fb3e46d2-4af7-4bd3-8703-5dad0d48ccb6 req-b391991a-33d5-4166-942d-d817d3b6e8d4 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Refreshing instance network info cache due to event network-changed-0976b526-dfa9-4ba0-8156-047450df099c. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fb3e46d2-4af7-4bd3-8703-5dad0d48ccb6 req-b391991a-33d5-4166-942d-d817d3b6e8d4 service nova] Acquiring lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.neutron [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.neutron [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Updating instance_info_cache with network_info: [{"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Releasing lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Instance network_info: |[{"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fb3e46d2-4af7-4bd3-8703-5dad0d48ccb6 req-b391991a-33d5-4166-942d-d817d3b6e8d4 service nova] Acquired lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.neutron [req-fb3e46d2-4af7-4bd3-8703-5dad0d48ccb6 req-b391991a-33d5-4166-942d-d817d3b6e8d4 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Refreshing network info cache for port 0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Start _get_guest_xml network_info=[{"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:27:08 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:27:08 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1423946976',display_name='tempest-AttachVolumeNegativeTest-server-1423946976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1423946976',id=41,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZTuatl5B5cLBf9vmWv3lBlVAYut/Cz7E4UuOF//ES+ixDQlhoR0zZM5uP4WfIve3SYcVGS48mJUYFxkQpBVsaKvziFzw5nbC09YRI/YtNlnH5KU1A9rGGSDiVVhgvuLQ==',key_name='tempest-keypair-338690452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-uwxgk7ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:27:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=1307ee99-42c0-4086-b8b1-120630450f5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:22:47,bridge_name='br-int',has_traffic_filtering=True,id=0976b526-dfa9-4ba0-8156-047450df099c,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976b526-df') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.objects.instance [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'pci_devices' on Instance uuid 1307ee99-42c0-4086-b8b1-120630450f5c {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:27:08 user nova-compute[72426]:   <uuid>1307ee99-42c0-4086-b8b1-120630450f5c</uuid>
Aug 01 08:27:08 user nova-compute[72426]:   <name>instance-00000029</name>
Aug 01 08:27:08 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:27:08 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:27:08 user nova-compute[72426]:   <metadata>
Aug 01 08:27:08 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:27:08 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:27:08 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1423946976</nova:name>
Aug 01 08:27:08 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:27:08</nova:creationTime>
Aug 01 08:27:08 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:27:08 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:27:08 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:27:08 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:27:08 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:27:08 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:27:08 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:27:08 user nova-compute[72426]:       <nova:owner>
Aug 01 08:27:08 user nova-compute[72426]:         <nova:user uuid="53c85b986ed140c491cd0ed264e561c7">tempest-AttachVolumeNegativeTest-1212503363-project-member</nova:user>
Aug 01 08:27:08 user nova-compute[72426]:         <nova:project uuid="0d0d23fc511343c698af4392fc3de94b">tempest-AttachVolumeNegativeTest-1212503363</nova:project>
Aug 01 08:27:08 user nova-compute[72426]:       </nova:owner>
Aug 01 08:27:08 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:27:08 user nova-compute[72426]:       <nova:ports>
Aug 01 08:27:08 user nova-compute[72426]:         <nova:port uuid="0976b526-dfa9-4ba0-8156-047450df099c">
Aug 01 08:27:08 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 08:27:08 user nova-compute[72426]:         </nova:port>
Aug 01 08:27:08 user nova-compute[72426]:       </nova:ports>
Aug 01 08:27:08 user nova-compute[72426]:     </nova:instance>
Aug 01 08:27:08 user nova-compute[72426]:   </metadata>
Aug 01 08:27:08 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:27:08 user nova-compute[72426]:     <system>
Aug 01 08:27:08 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:27:08 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:27:08 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:27:08 user nova-compute[72426]:       <entry name="serial">1307ee99-42c0-4086-b8b1-120630450f5c</entry>
Aug 01 08:27:08 user nova-compute[72426]:       <entry name="uuid">1307ee99-42c0-4086-b8b1-120630450f5c</entry>
Aug 01 08:27:08 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:27:08 user nova-compute[72426]:     </system>
Aug 01 08:27:08 user nova-compute[72426]:   </sysinfo>
Aug 01 08:27:08 user nova-compute[72426]:   <os>
Aug 01 08:27:08 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:27:08 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:27:08 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:27:08 user nova-compute[72426]:   </os>
Aug 01 08:27:08 user nova-compute[72426]:   <features>
Aug 01 08:27:08 user nova-compute[72426]:     <acpi/>
Aug 01 08:27:08 user nova-compute[72426]:     <apic/>
Aug 01 08:27:08 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:27:08 user nova-compute[72426]:   </features>
Aug 01 08:27:08 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:27:08 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:27:08 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:27:08 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:27:08 user nova-compute[72426]:   </clock>
Aug 01 08:27:08 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:27:08 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:27:08 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:27:08 user nova-compute[72426]:   </cpu>
Aug 01 08:27:08 user nova-compute[72426]:   <devices>
Aug 01 08:27:08 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:27:08 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:27:08 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk"/>
Aug 01 08:27:08 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:27:08 user nova-compute[72426]:     </disk>
Aug 01 08:27:08 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:27:08 user nova-compute[72426]:       <mac address="fa:16:3e:f9:22:47"/>
Aug 01 08:27:08 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:27:08 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:27:08 user nova-compute[72426]:       <target dev="tap0976b526-df"/>
Aug 01 08:27:08 user nova-compute[72426]:     </interface>
Aug 01 08:27:08 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:27:08 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/console.log" append="off"/>
Aug 01 08:27:08 user nova-compute[72426]:     </serial>
Aug 01 08:27:08 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:27:08 user nova-compute[72426]:     <video>
Aug 01 08:27:08 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:27:08 user nova-compute[72426]:     </video>
Aug 01 08:27:08 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:27:08 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:27:08 user nova-compute[72426]:     </rng>
Aug 01 08:27:08 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:27:08 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:27:08 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:27:08 user nova-compute[72426]:     </memballoon>
Aug 01 08:27:08 user nova-compute[72426]:   </devices>
Aug 01 08:27:08 user nova-compute[72426]: </domain>
Aug 01 08:27:08 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1423946976',display_name='tempest-AttachVolumeNegativeTest-server-1423946976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1423946976',id=41,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZTuatl5B5cLBf9vmWv3lBlVAYut/Cz7E4UuOF//ES+ixDQlhoR0zZM5uP4WfIve3SYcVGS48mJUYFxkQpBVsaKvziFzw5nbC09YRI/YtNlnH5KU1A9rGGSDiVVhgvuLQ==',key_name='tempest-keypair-338690452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-uwxgk7ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:27:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=1307ee99-42c0-4086-b8b1-120630450f5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:22:47,bridge_name='br-int',has_traffic_filtering=True,id=0976b526-dfa9-4ba0-8156-047450df099c,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976b526-df') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG os_vif [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:22:47,bridge_name='br-int',has_traffic_filtering=True,id=0976b526-dfa9-4ba0-8156-047450df099c,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976b526-df') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0976b526-df, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0976b526-df, col_values=(('external_ids', {'iface-id': '0976b526-dfa9-4ba0-8156-047450df099c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:22:47', 'vm-uuid': '1307ee99-42c0-4086-b8b1-120630450f5c'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:08 user nova-compute[72426]: INFO os_vif [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:22:47,bridge_name='br-int',has_traffic_filtering=True,id=0976b526-dfa9-4ba0-8156-047450df099c,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976b526-df')
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No VIF found with MAC fa:16:3e:f9:22:47, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.neutron [req-fb3e46d2-4af7-4bd3-8703-5dad0d48ccb6 req-b391991a-33d5-4166-942d-d817d3b6e8d4 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Updated VIF entry in instance network info cache for port 0976b526-dfa9-4ba0-8156-047450df099c. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:27:08 user nova-compute[72426]: DEBUG nova.network.neutron [req-fb3e46d2-4af7-4bd3-8703-5dad0d48ccb6 req-b391991a-33d5-4166-942d-d817d3b6e8d4 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Updating instance_info_cache with network_info: [{"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fb3e46d2-4af7-4bd3-8703-5dad0d48ccb6 req-b391991a-33d5-4166-942d-d817d3b6e8d4 service nova] Releasing lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:27:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-cce1f51d-a573-4185-a5ed-5d9bb3468c5f req-7ba6f7d4-3d22-4f2c-8ee9-3c389d841363 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received event network-vif-plugged-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cce1f51d-a573-4185-a5ed-5d9bb3468c5f req-7ba6f7d4-3d22-4f2c-8ee9-3c389d841363 service nova] Acquiring lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cce1f51d-a573-4185-a5ed-5d9bb3468c5f req-7ba6f7d4-3d22-4f2c-8ee9-3c389d841363 service nova] Lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cce1f51d-a573-4185-a5ed-5d9bb3468c5f req-7ba6f7d4-3d22-4f2c-8ee9-3c389d841363 service nova] Lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-cce1f51d-a573-4185-a5ed-5d9bb3468c5f req-7ba6f7d4-3d22-4f2c-8ee9-3c389d841363 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] No waiting events found dispatching network-vif-plugged-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:10 user nova-compute[72426]: WARNING nova.compute.manager [req-cce1f51d-a573-4185-a5ed-5d9bb3468c5f req-7ba6f7d4-3d22-4f2c-8ee9-3c389d841363 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received unexpected event network-vif-plugged-0976b526-dfa9-4ba0-8156-047450df099c for instance with vm_state building and task_state spawning.
Aug 01 08:27:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878432.1438777, 1307ee99-42c0-4086-b8b1-120630450f5c => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:27:12 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] VM Resumed (Lifecycle Event)
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:27:12 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Instance spawned successfully.
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:27:12 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878432.1469243, 1307ee99-42c0-4086-b8b1-120630450f5c => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:27:12 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] VM Started (Lifecycle Event)
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:27:12 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:27:12 user nova-compute[72426]: INFO nova.compute.manager [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Took 5.52 seconds to spawn the instance on the hypervisor.
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-b20d81d5-cdb5-412e-8131-5b29b84a3788 req-9a5e4cca-1918-4d55-98f3-30e691f74de2 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received event network-vif-plugged-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b20d81d5-cdb5-412e-8131-5b29b84a3788 req-9a5e4cca-1918-4d55-98f3-30e691f74de2 service nova] Acquiring lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b20d81d5-cdb5-412e-8131-5b29b84a3788 req-9a5e4cca-1918-4d55-98f3-30e691f74de2 service nova] Lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b20d81d5-cdb5-412e-8131-5b29b84a3788 req-9a5e4cca-1918-4d55-98f3-30e691f74de2 service nova] Lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG nova.compute.manager [req-b20d81d5-cdb5-412e-8131-5b29b84a3788 req-9a5e4cca-1918-4d55-98f3-30e691f74de2 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] No waiting events found dispatching network-vif-plugged-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:12 user nova-compute[72426]: WARNING nova.compute.manager [req-b20d81d5-cdb5-412e-8131-5b29b84a3788 req-9a5e4cca-1918-4d55-98f3-30e691f74de2 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received unexpected event network-vif-plugged-0976b526-dfa9-4ba0-8156-047450df099c for instance with vm_state building and task_state spawning.
Aug 01 08:27:12 user nova-compute[72426]: INFO nova.compute.manager [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Took 6.43 seconds to build instance.
Aug 01 08:27:12 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-967b69d0-cb23-4cf9-be0c-c7d81fb0e245 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.522s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:24 user nova-compute[72426]: INFO nova.compute.manager [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Terminating instance
Aug 01 08:27:24 user nova-compute[72426]: DEBUG nova.compute.manager [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:27:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-a8c8f970-2559-4983-852a-c9c8d9226fac req-c95b9cea-4efa-445e-b352-b385bdb95d64 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a8c8f970-2559-4983-852a-c9c8d9226fac req-c95b9cea-4efa-445e-b352-b385bdb95d64 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a8c8f970-2559-4983-852a-c9c8d9226fac req-c95b9cea-4efa-445e-b352-b385bdb95d64 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a8c8f970-2559-4983-852a-c9c8d9226fac req-c95b9cea-4efa-445e-b352-b385bdb95d64 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-a8c8f970-2559-4983-852a-c9c8d9226fac req-c95b9cea-4efa-445e-b352-b385bdb95d64 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-a8c8f970-2559-4983-852a-c9c8d9226fac req-c95b9cea-4efa-445e-b352-b385bdb95d64 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Instance destroyed successfully.
Aug 01 08:27:25 user nova-compute[72426]: DEBUG nova.objects.instance [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'resources' on Instance uuid e1119088-18c7-483d-a89d-3b5d19054e52 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-786606183',display_name='tempest-AttachVolumeTestJSON-server-786606183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-786606183',id=27,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhMcMLFpWRtcugrzk5/raTjStSXB9ipq79Xl+iZRLvhAJzQsUrNTa4A33Y+LFLAJhexCpWGTXgzOp8ywgg15r2gAc8AxCfNY7zz3j9aWRNC0qS56zJkCjoe3hYKglRjfQ==',key_name='tempest-keypair-1553423732',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-rcziynoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:25:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=e1119088-18c7-483d-a89d-3b5d19054e52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "address": "fa:16:3e:d4:cf:4b", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f0b410f-c4", "ovs_interfaceid": "9f0b410f-c412-4817-9db3-b9ec5ffe8c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG os_vif [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f0b410f-c4, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:25 user nova-compute[72426]: INFO os_vif [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:cf:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f0b410f-c4')
Aug 01 08:27:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Deleting instance files /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52_del
Aug 01 08:27:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Deletion of /opt/stack/data/nova/instances/e1119088-18c7-483d-a89d-3b5d19054e52_del complete
Aug 01 08:27:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:25 user nova-compute[72426]: INFO nova.compute.manager [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 08:27:25 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:27:25 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:26 user nova-compute[72426]: INFO nova.compute.manager [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Terminating instance
Aug 01 08:27:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Took 0.98 seconds to deallocate network for instance.
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-c0abb940-0bdb-4c12-a823-b5ef7ee17176 req-f572830d-78ff-4ebe-bf10-1a8e8d8d9c99 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-deleted-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:26 user nova-compute[72426]: INFO nova.compute.manager [req-c0abb940-0bdb-4c12-a823-b5ef7ee17176 req-f572830d-78ff-4ebe-bf10-1a8e8d8d9c99 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Neutron deleted interface 9f0b410f-c412-4817-9db3-b9ec5ffe8c09; detaching it from the instance and deleting it from the info cache
Aug 01 08:27:26 user nova-compute[72426]: DEBUG nova.network.neutron [req-c0abb940-0bdb-4c12-a823-b5ef7ee17176 req-f572830d-78ff-4ebe-bf10-1a8e8d8d9c99 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-c0abb940-0bdb-4c12-a823-b5ef7ee17176 req-f572830d-78ff-4ebe-bf10-1a8e8d8d9c99 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Detach interface failed, port_id=9f0b410f-c412-4817-9db3-b9ec5ffe8c09, reason: Instance e1119088-18c7-483d-a89d-3b5d19054e52 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Instance destroyed successfully.
Aug 01 08:27:26 user nova-compute[72426]: DEBUG nova.objects.instance [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'resources' on Instance uuid 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1277733807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1277733807',id=12,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-pq9iq1e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:15:26Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=0efe4ed7-ea8a-485e-b7db-df92ba58f7b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "2ab312e8-542a-48ce-992f-055264f86613", "address": "fa:16:3e:9e:6b:07", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab312e8-54", "ovs_interfaceid": "2ab312e8-542a-48ce-992f-055264f86613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6b:07,bridge_name='br-int',has_traffic_filtering=True,id=2ab312e8-542a-48ce-992f-055264f86613,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab312e8-54') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_vif [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6b:07,bridge_name='br-int',has_traffic_filtering=True,id=2ab312e8-542a-48ce-992f-055264f86613,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab312e8-54') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ab312e8-54, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:27:26 user nova-compute[72426]: INFO os_vif [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:6b:07,bridge_name='br-int',has_traffic_filtering=True,id=2ab312e8-542a-48ce-992f-055264f86613,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab312e8-54')
Aug 01 08:27:26 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mekxUFXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:27:26 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e49a05-0d3e-4c19-bbdf-216ed8b9cf30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f052421-b05f-4866-be12-deb801955c5e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:27:26 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:27:26 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:27:26 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c (non-flash)
Aug 01 08:27:26 user nova-compute[72426]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:27:26 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:27:26 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c3f6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b27e40-682e-4d90-bc39-6df824b27ed5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e3c349-043c-4cfb-ab09-cfd0decf13a2]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d462c9e-9dd4-4538-bf2a-334c53df6751]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:27:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13ba48b-5dc8-403e-9199-797c77ac4abd]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c05f40c-f488-4146-910d-a0ac722e18c8]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7446a0e7-15d1-406e-934f-f885848df31d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c, portal: 172.16.0.220,3260]
Aug 01 08:27:27 user nova-compute[72426]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c, portal: 172.16.0.220,3260] successful.
Aug 01 08:27:27 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6baec9-b9c7-4eb2-8122-1f67cc55672c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7bea15-e1bf-4076-93b7-c750fceda433]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] <== disconnect_volume: return (297ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:27:27 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Deleting instance files /opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6_del
Aug 01 08:27:27 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Deletion of /opt/stack/data/nova/instances/0efe4ed7-ea8a-485e-b7db-df92ba58f7b6_del complete
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:27 user nova-compute[72426]: INFO nova.compute.manager [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:27:27 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Deleted allocations for instance e1119088-18c7-483d-a89d-3b5d19054e52
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:27 user nova-compute[72426]: WARNING nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state deleted and task_state None.
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:27 user nova-compute[72426]: WARNING nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state deleted and task_state None.
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:27 user nova-compute[72426]: WARNING nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state deleted and task_state None.
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:27 user nova-compute[72426]: WARNING nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-unplugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state deleted and task_state None.
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Acquiring lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "e1119088-18c7-483d-a89d-3b5d19054e52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] No waiting events found dispatching network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:27 user nova-compute[72426]: WARNING nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Received unexpected event network-vif-plugged-9f0b410f-c412-4817-9db3-b9ec5ffe8c09 for instance with vm_state deleted and task_state None.
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-unplugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-unplugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-9f0ded00-37a5-4441-9a2d-ece4762b12bb req-9474347a-af81-4775-8cc7-19f6d0d6db72 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-unplugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-318a405b-d30d-4219-ace0-70989bb5264d tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "e1119088-18c7-483d-a89d-3b5d19054e52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.609s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:27 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:27 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Took 0.58 seconds to deallocate network for instance.
Aug 01 08:27:28 user nova-compute[72426]: INFO nova.compute.manager [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Took 0.77 seconds to detach 1 volumes for instance.
Aug 01 08:27:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-50d6c556-c5de-4a97-a225-783e8bf8afc8 req-e090be99-3a00-400e-a89b-872081f9913e service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-deleted-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:28 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:27:28 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:27:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:29 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Deleted allocations for instance 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6
Aug 01 08:27:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-4dcce54d-9bc6-4e89-ba60-d54cf8481356 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.101s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-502fdb2a-b9cb-4e6c-b27e-5cb6112e2325 req-6f76da1d-807a-4c3c-8f0e-dbb21c529176 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-502fdb2a-b9cb-4e6c-b27e-5cb6112e2325 req-6f76da1d-807a-4c3c-8f0e-dbb21c529176 service nova] Acquiring lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-502fdb2a-b9cb-4e6c-b27e-5cb6112e2325 req-6f76da1d-807a-4c3c-8f0e-dbb21c529176 service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-502fdb2a-b9cb-4e6c-b27e-5cb6112e2325 req-6f76da1d-807a-4c3c-8f0e-dbb21c529176 service nova] Lock "0efe4ed7-ea8a-485e-b7db-df92ba58f7b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-502fdb2a-b9cb-4e6c-b27e-5cb6112e2325 req-6f76da1d-807a-4c3c-8f0e-dbb21c529176 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] No waiting events found dispatching network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:29 user nova-compute[72426]: WARNING nova.compute.manager [req-502fdb2a-b9cb-4e6c-b27e-5cb6112e2325 req-6f76da1d-807a-4c3c-8f0e-dbb21c529176 service nova] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Received unexpected event network-vif-plugged-2ab312e8-542a-48ce-992f-055264f86613 for instance with vm_state deleted and task_state None.
Aug 01 08:27:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:36 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:27:36 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=6963MB free_disk=25.00369644165039GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c10d6140-aa17-4342-9135-d07a73285483 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 37dab412-5a15-46e8-844e-2ef0c03b7181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c707f931-d77d-44c8-a352-49e673ff6c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 8fff7c8e-8129-40f3-ac3b-9b60408705ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 1fc3bc29-8fc0-41ee-b54c-90d960996c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 9a381085-5df7-453e-8631-995ab647cabe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 1307ee99-42c0-4086-b8b1-120630450f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:27:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:37 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:27:37 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:27:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:27:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:39 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:27:39 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:27:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:27:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:27:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:27:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:27:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updating instance_info_cache with network_info: [{"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:27:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:27:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:27:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:27:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:27:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:27:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:27:40 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878445.5585997, e1119088-18c7-483d-a89d-3b5d19054e52 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:27:40 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] VM Stopped (Lifecycle Event)
Aug 01 08:27:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ac8578ea-4f0c-4d8a-b727-75ba6da3b031 None None] [instance: e1119088-18c7-483d-a89d-3b5d19054e52] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:27:41 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878446.811678, 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:27:41 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] VM Stopped (Lifecycle Event)
Aug 01 08:27:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a37241aa-d03c-4086-9af1-014bd53c19f9 None None] [instance: 0efe4ed7-ea8a-485e-b7db-df92ba58f7b6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:27:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:27:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-fbe42e41-6909-41b3-900b-310ad56af209 req-4ff9beb3-e370-4f2f-8f65-e96d90a87999 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-changed-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-fbe42e41-6909-41b3-900b-310ad56af209 req-4ff9beb3-e370-4f2f-8f65-e96d90a87999 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Refreshing instance network info cache due to event network-changed-1705fdbb-5832-4b95-8bde-3ba0de7a4f34. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:27:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fbe42e41-6909-41b3-900b-310ad56af209 req-4ff9beb3-e370-4f2f-8f65-e96d90a87999 service nova] Acquiring lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:27:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fbe42e41-6909-41b3-900b-310ad56af209 req-4ff9beb3-e370-4f2f-8f65-e96d90a87999 service nova] Acquired lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:27:47 user nova-compute[72426]: DEBUG nova.network.neutron [req-fbe42e41-6909-41b3-900b-310ad56af209 req-4ff9beb3-e370-4f2f-8f65-e96d90a87999 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Refreshing network info cache for port 1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:27:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG nova.network.neutron [req-fbe42e41-6909-41b3-900b-310ad56af209 req-4ff9beb3-e370-4f2f-8f65-e96d90a87999 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updated VIF entry in instance network info cache for port 1705fdbb-5832-4b95-8bde-3ba0de7a4f34. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG nova.network.neutron [req-fbe42e41-6909-41b3-900b-310ad56af209 req-4ff9beb3-e370-4f2f-8f65-e96d90a87999 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updating instance_info_cache with network_info: [{"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fbe42e41-6909-41b3-900b-310ad56af209 req-4ff9beb3-e370-4f2f-8f65-e96d90a87999 service nova] Releasing lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-b4b8013e-3ca9-4f86-82c4-affabdc0c39d req-6a645f57-7d79-4224-9f8e-4ee9946b99a9 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-changed-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-b4b8013e-3ca9-4f86-82c4-affabdc0c39d req-6a645f57-7d79-4224-9f8e-4ee9946b99a9 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Refreshing instance network info cache due to event network-changed-1705fdbb-5832-4b95-8bde-3ba0de7a4f34. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b4b8013e-3ca9-4f86-82c4-affabdc0c39d req-6a645f57-7d79-4224-9f8e-4ee9946b99a9 service nova] Acquiring lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b4b8013e-3ca9-4f86-82c4-affabdc0c39d req-6a645f57-7d79-4224-9f8e-4ee9946b99a9 service nova] Acquired lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG nova.network.neutron [req-b4b8013e-3ca9-4f86-82c4-affabdc0c39d req-6a645f57-7d79-4224-9f8e-4ee9946b99a9 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Refreshing network info cache for port 1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:48 user nova-compute[72426]: INFO nova.compute.manager [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Detaching volume ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8
Aug 01 08:27:48 user nova-compute[72426]: INFO nova.virt.block_device [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Attempting to driver detach volume ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 from mountpoint /dev/vdb
Aug 01 08:27:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Attempting to detach device vdb from instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:27:48 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:27:48 user nova-compute[72426]:   <source dev="/dev/sdd"/>
Aug 01 08:27:48 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:27:48 user nova-compute[72426]:   <serial>ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8</serial>
Aug 01 08:27:48 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:27:48 user nova-compute[72426]: </disk>
Aug 01 08:27:48 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:27:48 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Successfully detached device vdb from instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 from the persistent domain config.
Aug 01 08:27:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:27:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:27:48 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:27:48 user nova-compute[72426]:   <source dev="/dev/sdd"/>
Aug 01 08:27:48 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:27:48 user nova-compute[72426]:   <serial>ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8</serial>
Aug 01 08:27:48 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:27:48 user nova-compute[72426]: </disk>
Aug 01 08:27:48 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-b4b8013e-3ca9-4f86-82c4-affabdc0c39d req-6a645f57-7d79-4224-9f8e-4ee9946b99a9 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updated VIF entry in instance network info cache for port 1705fdbb-5832-4b95-8bde-3ba0de7a4f34. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-b4b8013e-3ca9-4f86-82c4-affabdc0c39d req-6a645f57-7d79-4224-9f8e-4ee9946b99a9 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updating instance_info_cache with network_info: [{"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b4b8013e-3ca9-4f86-82c4-affabdc0c39d req-6a645f57-7d79-4224-9f8e-4ee9946b99a9 service nova] Releasing lock "refresh_cache-bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878469.2684174, bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:27:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Successfully detached device vdb from instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 from the live domain config.
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bWRprNBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:27:49 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-5bcbc6e3-638c-4929-8081-06ae7c26bb4e req-9a5f179c-24b4-4a7d-9bc5-c793096327f2 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received event network-changed-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-5bcbc6e3-638c-4929-8081-06ae7c26bb4e req-9a5f179c-24b4-4a7d-9bc5-c793096327f2 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Refreshing instance network info cache due to event network-changed-550346c3-b6a2-4aec-a520-93f161d77018. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5bcbc6e3-638c-4929-8081-06ae7c26bb4e req-9a5f179c-24b4-4a7d-9bc5-c793096327f2 service nova] Acquiring lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5bcbc6e3-638c-4929-8081-06ae7c26bb4e req-9a5f179c-24b4-4a7d-9bc5-c793096327f2 service nova] Acquired lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-5bcbc6e3-638c-4929-8081-06ae7c26bb4e req-9a5f179c-24b4-4a7d-9bc5-c793096327f2 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Refreshing network info cache for port 550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[be59e756-1f1a-45e2-b41e-2dccd19f7e40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8726a5-70c6-4398-be74-75a83d8bda9f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:27:49 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:27:49 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:27:49 user nova-compute[72426]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 (non-flash)
Aug 01 08:27:49 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c46dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8'): ({'sdd'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Removing single pathed devices sdd {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[617cdb76-2f55-4ba1-b807-86b47da2c23b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efb5dbc-a247-4ce3-a437-723cf62f5597]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Flushing IO for device /dev/sdd {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:49 user nova-compute[72426]: INFO nova.compute.manager [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Terminating instance
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdccab3-8d52-4ecf-80da-5bb97af5b60b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aa231e-eebf-410e-bc96-9b9f6fa15366]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8643266-097f-493f-9995-f437da206082]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd51e46e-c0c0-4de5-bb1c-4ef676185db0]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8, portal: 172.16.0.220,3260]
Aug 01 08:27:49 user nova-compute[72426]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8, portal: 172.16.0.220,3260] successful.
Aug 01 08:27:49 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9ff9d1-dd7b-43eb-bd08-87fca8757bd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe73f18-1361-42b6-8c84-ed816f997ce3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] <== disconnect_volume: return (298ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-8588dbfe-6ed3-4567-a62a-d1fa99f13e96 req-c2750e82-ae15-4053-9b84-7228d5514aec service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received event network-vif-unplugged-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8588dbfe-6ed3-4567-a62a-d1fa99f13e96 req-c2750e82-ae15-4053-9b84-7228d5514aec service nova] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8588dbfe-6ed3-4567-a62a-d1fa99f13e96 req-c2750e82-ae15-4053-9b84-7228d5514aec service nova] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8588dbfe-6ed3-4567-a62a-d1fa99f13e96 req-c2750e82-ae15-4053-9b84-7228d5514aec service nova] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-8588dbfe-6ed3-4567-a62a-d1fa99f13e96 req-c2750e82-ae15-4053-9b84-7228d5514aec service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] No waiting events found dispatching network-vif-unplugged-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-8588dbfe-6ed3-4567-a62a-d1fa99f13e96 req-c2750e82-ae15-4053-9b84-7228d5514aec service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received event network-vif-unplugged-550346c3-b6a2-4aec-a520-93f161d77018 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-5bcbc6e3-638c-4929-8081-06ae7c26bb4e req-9a5f179c-24b4-4a7d-9bc5-c793096327f2 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Updated VIF entry in instance network info cache for port 550346c3-b6a2-4aec-a520-93f161d77018. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-5bcbc6e3-638c-4929-8081-06ae7c26bb4e req-9a5f179c-24b4-4a7d-9bc5-c793096327f2 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Updating instance_info_cache with network_info: [{"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5bcbc6e3-638c-4929-8081-06ae7c26bb4e req-9a5f179c-24b4-4a7d-9bc5-c793096327f2 service nova] Releasing lock "refresh_cache-1fc3bc29-8fc0-41ee-b54c-90d960996c41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:27:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Instance destroyed successfully.
Aug 01 08:27:50 user nova-compute[72426]: DEBUG nova.objects.instance [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'resources' on Instance uuid 1fc3bc29-8fc0-41ee-b54c-90d960996c41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-397800128',display_name='tempest-TestStampPattern-server-397800128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-397800128',id=38,image_ref='38626285-d64a-4eec-a829-641ce39effcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzi07fWEZm9ZDpMiwLaYbjLSFJSACGngqPGH6IXGkKdZqaHEkFII80iFN525qE1V6pVTrPP41DJXrIqlOvHoD2AT4HCLJUUwmYLnWGEElwg4L0QUNN1qgp0PiMSAfYWeA==',key_name='tempest-TestStampPattern-721892585',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:24:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ff89c616cbd48e685d1d4330c874bb7',ramdisk_id='',reservation_id='r-oocvb6wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='37dab412-5a15-46e8-844e-2ef0c03b7181',image_min_disk='1',image_min_ram='0',image_owner_id='1ff89c616cbd48e685d1d4330c874bb7',image_owner_project_name='tempest-TestStampPattern-936652585',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-936652585-project-member',image_user_id='56d58ffe9bad4d1fb35367ac0e60d181',owner_project_name='tempest-TestStampPattern-936652585',owner_user_name='tempest-TestStampPattern-936652585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:24:59Z,user_data=None,user_id='56d58ffe9bad4d1fb35367ac0e60d181',uuid=1fc3bc29-8fc0-41ee-b54c-90d960996c41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converting VIF {"id": "550346c3-b6a2-4aec-a520-93f161d77018", "address": "fa:16:3e:d7:0b:8b", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap550346c3-b6", "ovs_interfaceid": "550346c3-b6a2-4aec-a520-93f161d77018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:0b:8b,bridge_name='br-int',has_traffic_filtering=True,id=550346c3-b6a2-4aec-a520-93f161d77018,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550346c3-b6') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG os_vif [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:0b:8b,bridge_name='br-int',has_traffic_filtering=True,id=550346c3-b6a2-4aec-a520-93f161d77018,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550346c3-b6') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap550346c3-b6, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:27:50 user nova-compute[72426]: INFO os_vif [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:0b:8b,bridge_name='br-int',has_traffic_filtering=True,id=550346c3-b6a2-4aec-a520-93f161d77018,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap550346c3-b6')
Aug 01 08:27:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Deleting instance files /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41_del
Aug 01 08:27:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Deletion of /opt/stack/data/nova/instances/1fc3bc29-8fc0-41ee-b54c-90d960996c41_del complete
Aug 01 08:27:50 user nova-compute[72426]: INFO nova.compute.manager [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 08:27:50 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG nova.objects.instance [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'flavor' on Instance uuid bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-72e6e5b3-ebb9-4e3c-8556-f2653627b77f tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.725s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:50 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Took 0.53 seconds to deallocate network for instance.
Aug 01 08:27:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:51 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:27:51 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:27:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:51 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Deleted allocations for instance 1fc3bc29-8fc0-41ee-b54c-90d960996c41
Aug 01 08:27:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-bbb3fcfb-cfea-472d-988e-412462fd0430 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.899s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-1ef65c7f-8f9c-4a28-b336-89dc85ccde3e req-bba78939-a8de-47e8-810d-95eaed760071 service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received event network-vif-deleted-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-201c1c0e-4649-45c1-bfde-cabc95ad9316 req-d6bb748d-3651-4932-8b97-f21d9f6b84cb service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received event network-vif-plugged-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-201c1c0e-4649-45c1-bfde-cabc95ad9316 req-d6bb748d-3651-4932-8b97-f21d9f6b84cb service nova] Acquiring lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-201c1c0e-4649-45c1-bfde-cabc95ad9316 req-d6bb748d-3651-4932-8b97-f21d9f6b84cb service nova] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-201c1c0e-4649-45c1-bfde-cabc95ad9316 req-d6bb748d-3651-4932-8b97-f21d9f6b84cb service nova] Lock "1fc3bc29-8fc0-41ee-b54c-90d960996c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-201c1c0e-4649-45c1-bfde-cabc95ad9316 req-d6bb748d-3651-4932-8b97-f21d9f6b84cb service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] No waiting events found dispatching network-vif-plugged-550346c3-b6a2-4aec-a520-93f161d77018 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:51 user nova-compute[72426]: WARNING nova.compute.manager [req-201c1c0e-4649-45c1-bfde-cabc95ad9316 req-d6bb748d-3651-4932-8b97-f21d9f6b84cb service nova] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Received unexpected event network-vif-plugged-550346c3-b6a2-4aec-a520-93f161d77018 for instance with vm_state deleted and task_state None.
Aug 01 08:27:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "9a381085-5df7-453e-8631-995ab647cabe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "9a381085-5df7-453e-8631-995ab647cabe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "9a381085-5df7-453e-8631-995ab647cabe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "9a381085-5df7-453e-8631-995ab647cabe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "9a381085-5df7-453e-8631-995ab647cabe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:56 user nova-compute[72426]: INFO nova.compute.manager [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Terminating instance
Aug 01 08:27:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-7e628358-71da-487f-8f36-4a3950d0e62c req-d0d6f7b0-e4ba-4b23-bb35-9d1a8af64ea7 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Received event network-vif-unplugged-014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7e628358-71da-487f-8f36-4a3950d0e62c req-d0d6f7b0-e4ba-4b23-bb35-9d1a8af64ea7 service nova] Acquiring lock "9a381085-5df7-453e-8631-995ab647cabe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7e628358-71da-487f-8f36-4a3950d0e62c req-d0d6f7b0-e4ba-4b23-bb35-9d1a8af64ea7 service nova] Lock "9a381085-5df7-453e-8631-995ab647cabe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7e628358-71da-487f-8f36-4a3950d0e62c req-d0d6f7b0-e4ba-4b23-bb35-9d1a8af64ea7 service nova] Lock "9a381085-5df7-453e-8631-995ab647cabe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-7e628358-71da-487f-8f36-4a3950d0e62c req-d0d6f7b0-e4ba-4b23-bb35-9d1a8af64ea7 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] No waiting events found dispatching network-vif-unplugged-014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG nova.compute.manager [req-7e628358-71da-487f-8f36-4a3950d0e62c req-d0d6f7b0-e4ba-4b23-bb35-9d1a8af64ea7 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Received event network-vif-unplugged-014c7d18-8891-4ef4-af3e-72c15509fd5f for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Instance destroyed successfully.
Aug 01 08:27:56 user nova-compute[72426]: DEBUG nova.objects.instance [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lazy-loading 'resources' on Instance uuid 9a381085-5df7-453e-8631-995ab647cabe {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-168140463',display_name='tempest-ServersNegativeTestJSON-server-168140463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-168140463',id=39,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:26:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9859557c06bf4d50937390421acca14f',ramdisk_id='',reservation_id='r-d0es2b4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-330621956',owner_user_name='tempest-ServersNegativeTestJSON-330621956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:26:14Z,user_data=None,user_id='6db1631e91f1462c9a1433fc10eba8bf',uuid=9a381085-5df7-453e-8631-995ab647cabe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "address": "fa:16:3e:9e:9e:99", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014c7d18-88", "ovs_interfaceid": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converting VIF {"id": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "address": "fa:16:3e:9e:9e:99", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap014c7d18-88", "ovs_interfaceid": "014c7d18-8891-4ef4-af3e-72c15509fd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9e:99,bridge_name='br-int',has_traffic_filtering=True,id=014c7d18-8891-4ef4-af3e-72c15509fd5f,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014c7d18-88') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG os_vif [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9e:99,bridge_name='br-int',has_traffic_filtering=True,id=014c7d18-8891-4ef4-af3e-72c15509fd5f,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014c7d18-88') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap014c7d18-88, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:27:56 user nova-compute[72426]: INFO os_vif [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:9e:99,bridge_name='br-int',has_traffic_filtering=True,id=014c7d18-8891-4ef4-af3e-72c15509fd5f,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap014c7d18-88')
Aug 01 08:27:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Deleting instance files /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe_del
Aug 01 08:27:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Deletion of /opt/stack/data/nova/instances/9a381085-5df7-453e-8631-995ab647cabe_del complete
Aug 01 08:27:56 user nova-compute[72426]: INFO nova.compute.manager [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 01 08:27:56 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:27:56 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 9a381085-5df7-453e-8631-995ab647cabe] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:27:57 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:57 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Took 0.49 seconds to deallocate network for instance.
Aug 01 08:27:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-c39809d0-0be7-4f4b-9c9f-5f46a9c7af0c req-6a846416-cea4-4134-8d59-3a820e427015 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Received event network-vif-deleted-014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:57 user nova-compute[72426]: INFO nova.compute.manager [req-c39809d0-0be7-4f4b-9c9f-5f46a9c7af0c req-6a846416-cea4-4134-8d59-3a820e427015 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Neutron deleted interface 014c7d18-8891-4ef4-af3e-72c15509fd5f; detaching it from the instance and deleting it from the info cache
Aug 01 08:27:57 user nova-compute[72426]: DEBUG nova.network.neutron [req-c39809d0-0be7-4f4b-9c9f-5f46a9c7af0c req-6a846416-cea4-4134-8d59-3a820e427015 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:27:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-c39809d0-0be7-4f4b-9c9f-5f46a9c7af0c req-6a846416-cea4-4134-8d59-3a820e427015 service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Detach interface failed, port_id=014c7d18-8891-4ef4-af3e-72c15509fd5f, reason: Instance 9a381085-5df7-453e-8631-995ab647cabe could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:27:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:57 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:27:57 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:27:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:57 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Deleted allocations for instance 9a381085-5df7-453e-8631-995ab647cabe
Aug 01 08:27:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7ceda475-fa92-4777-ae9d-b9f76619887f tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "9a381085-5df7-453e-8631-995ab647cabe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.647s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-a1faaf95-668b-48af-92a3-167562762d62 req-d6208aee-00d8-42e0-b620-43f81cac5aec service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Received event network-vif-plugged-014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:27:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a1faaf95-668b-48af-92a3-167562762d62 req-d6208aee-00d8-42e0-b620-43f81cac5aec service nova] Acquiring lock "9a381085-5df7-453e-8631-995ab647cabe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:27:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a1faaf95-668b-48af-92a3-167562762d62 req-d6208aee-00d8-42e0-b620-43f81cac5aec service nova] Lock "9a381085-5df7-453e-8631-995ab647cabe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:27:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a1faaf95-668b-48af-92a3-167562762d62 req-d6208aee-00d8-42e0-b620-43f81cac5aec service nova] Lock "9a381085-5df7-453e-8631-995ab647cabe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:27:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-a1faaf95-668b-48af-92a3-167562762d62 req-d6208aee-00d8-42e0-b620-43f81cac5aec service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] No waiting events found dispatching network-vif-plugged-014c7d18-8891-4ef4-af3e-72c15509fd5f {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:27:58 user nova-compute[72426]: WARNING nova.compute.manager [req-a1faaf95-668b-48af-92a3-167562762d62 req-d6208aee-00d8-42e0-b620-43f81cac5aec service nova] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Received unexpected event network-vif-plugged-014c7d18-8891-4ef4-af3e-72c15509fd5f for instance with vm_state deleted and task_state None.
Aug 01 08:28:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "468edb40-0972-4589-9395-826c1eeb0dc6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:02 user nova-compute[72426]: INFO nova.compute.manager [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Unshelving
Aug 01 08:28:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:02 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'pci_requests' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:02 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'numa_topology' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:28:02 user nova-compute[72426]: INFO nova.compute.claims [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Claim successful on node user
Aug 01 08:28:03 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:28:03 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:28:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:03 user nova-compute[72426]: INFO nova.network.neutron [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updating port f2a59028-82a7-4744-82f8-b9b0ec197596 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquired lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG nova.network.neutron [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-43605e75-8995-4904-b14e-452b6f970fef req-cf3732fb-9ada-4b05-a4fc-4839676ed084 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-changed-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-43605e75-8995-4904-b14e-452b6f970fef req-cf3732fb-9ada-4b05-a4fc-4839676ed084 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Refreshing instance network info cache due to event network-changed-f2a59028-82a7-4744-82f8-b9b0ec197596. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-43605e75-8995-4904-b14e-452b6f970fef req-cf3732fb-9ada-4b05-a4fc-4839676ed084 service nova] Acquiring lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG nova.network.neutron [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updating instance_info_cache with network_info: [{"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Releasing lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:28:04 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Creating image(s)
Aug 01 08:28:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "/opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "/opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "/opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'trusted_certs' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-43605e75-8995-4904-b14e-452b6f970fef req-cf3732fb-9ada-4b05-a4fc-4839676ed084 service nova] Acquired lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG nova.network.neutron [req-43605e75-8995-4904-b14e-452b6f970fef req-cf3732fb-9ada-4b05-a4fc-4839676ed084 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Refreshing network info cache for port f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "d28d4e1243cb60d247ed3b51e080d6520f7bedb4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "d28d4e1243cb60d247ed3b51e080d6520f7bedb4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4.part --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878470.179812, 1fc3bc29-8fc0-41ee-b54c-90d960996c41 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:28:05 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] VM Stopped (Lifecycle Event)
Aug 01 08:28:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-369dddb3-c4ca-4e43-9b8a-520c0e704426 req-abb6a7d3-e762-4b5f-993e-9c549736117a service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-changed-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-369dddb3-c4ca-4e43-9b8a-520c0e704426 req-abb6a7d3-e762-4b5f-993e-9c549736117a service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Refreshing instance network info cache due to event network-changed-068c4e66-773c-4192-ab91-664b48a5fe9e. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-369dddb3-c4ca-4e43-9b8a-520c0e704426 req-abb6a7d3-e762-4b5f-993e-9c549736117a service nova] Acquiring lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-369dddb3-c4ca-4e43-9b8a-520c0e704426 req-abb6a7d3-e762-4b5f-993e-9c549736117a service nova] Acquired lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG nova.network.neutron [req-369dddb3-c4ca-4e43-9b8a-520c0e704426 req-abb6a7d3-e762-4b5f-993e-9c549736117a service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Refreshing network info cache for port 068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG nova.compute.manager [None req-092a33ef-dd5f-4896-9ce3-46f95fce0f05 None None] [instance: 1fc3bc29-8fc0-41ee-b54c-90d960996c41] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:05 user nova-compute[72426]: INFO nova.compute.manager [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Detaching volume 79af08fc-5c5e-40c6-b57b-c1014b2d2b32
Aug 01 08:28:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4.part --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG nova.virt.images [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] 626ce0eb-0b53-4a9c-bec8-f21755becccd was qcow2, converting to raw {{(pid=72426) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG nova.privsep.utils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72426) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4.part /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4.converted {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:05 user nova-compute[72426]: INFO nova.virt.block_device [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Attempting to driver detach volume 79af08fc-5c5e-40c6-b57b-c1014b2d2b32 from mountpoint /dev/vdb
Aug 01 08:28:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Attempting to detach device vdb from instance c707f931-d77d-44c8-a352-49e673ff6c0b from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:28:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:28:05 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:28:05 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:28:05 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:28:05 user nova-compute[72426]:   <serial>79af08fc-5c5e-40c6-b57b-c1014b2d2b32</serial>
Aug 01 08:28:05 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:28:05 user nova-compute[72426]: </disk>
Aug 01 08:28:05 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:28:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Successfully detached device vdb from instance c707f931-d77d-44c8-a352-49e673ff6c0b from the persistent domain config.
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c707f931-d77d-44c8-a352-49e673ff6c0b from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:28:06 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:28:06 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:28:06 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:28:06 user nova-compute[72426]:   <serial>79af08fc-5c5e-40c6-b57b-c1014b2d2b32</serial>
Aug 01 08:28:06 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:28:06 user nova-compute[72426]: </disk>
Aug 01 08:28:06 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4.part /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4.converted" returned: 0 in 0.454s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4.converted --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "d28d4e1243cb60d247ed3b51e080d6520f7bedb4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.801s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878486.5966327, c707f931-d77d-44c8-a352-49e673ff6c0b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:28:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Successfully detached device vdb from instance c707f931-d77d-44c8-a352-49e673ff6c0b from the live domain config.
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rARPWiwp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:28:06 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4 --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "d28d4e1243cb60d247ed3b51e080d6520f7bedb4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "d28d4e1243cb60d247ed3b51e080d6520f7bedb4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb41d14-6963-4512-bd88-af6b9d1fa8b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03cade8-a699-4a60-a48c-129348b36362]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:28:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 (non-flash)
Aug 01 08:28:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38fe05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.network.neutron [req-43605e75-8995-4904-b14e-452b6f970fef req-cf3732fb-9ada-4b05-a4fc-4839676ed084 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updated VIF entry in instance network info cache for port f2a59028-82a7-4744-82f8-b9b0ec197596. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.network.neutron [req-43605e75-8995-4904-b14e-452b6f970fef req-cf3732fb-9ada-4b05-a4fc-4839676ed084 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updating instance_info_cache with network_info: [{"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[50913494-95f8-4675-89e9-f82dd9d82de5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-43605e75-8995-4904-b14e-452b6f970fef req-cf3732fb-9ada-4b05-a4fc-4839676ed084 service nova] Releasing lock "refresh_cache-468edb40-0972-4589-9395-826c1eeb0dc6" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e69e8-b234-4c93-8369-6045cb4db8d4]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54f0d4d-cb7d-4c9f-a173-a449ec292dfa]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4 --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4,backing_fmt=raw /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.network.neutron [req-369dddb3-c4ca-4e43-9b8a-520c0e704426 req-abb6a7d3-e762-4b5f-993e-9c549736117a service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updated VIF entry in instance network info cache for port 068c4e66-773c-4192-ab91-664b48a5fe9e. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.network.neutron [req-369dddb3-c4ca-4e43-9b8a-520c0e704426 req-abb6a7d3-e762-4b5f-993e-9c549736117a service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating instance_info_cache with network_info: [{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[100dabcc-9691-4295-aa0c-40b1ea15a19f]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4,backing_fmt=raw /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk 1073741824" returned: 0 in 0.058s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "d28d4e1243cb60d247ed3b51e080d6520f7bedb4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0d49a2-8af5-42f1-a082-f76708d76780]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-369dddb3-c4ca-4e43-9b8a-520c0e704426 req-abb6a7d3-e762-4b5f-993e-9c549736117a service nova] Releasing lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c56930-c2b9-420b-b652-7ccb10923c14]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32, portal: 172.16.0.220,3260]
Aug 01 08:28:06 user nova-compute[72426]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32, portal: 172.16.0.220,3260] successful.
Aug 01 08:28:06 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79af08fc-5c5e-40c6-b57b-c1014b2d2b32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eee7c2-308f-494a-8d35-9ad2a152b946]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] <== disconnect_volume: return (328ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d28d4e1243cb60d247ed3b51e080d6520f7bedb4 --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:06 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'migration_context' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Rebasing disk image.
Aug 01 08:28:06 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 -F raw /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-ab82ab2b-0a93-4a1c-a4d8-66c61ff6df9b req-a4dc2a9e-ee1d-4b0c-a5e4-70b5c05e6c49 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-changed-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-ab82ab2b-0a93-4a1c-a4d8-66c61ff6df9b req-a4dc2a9e-ee1d-4b0c-a5e4-70b5c05e6c49 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Refreshing instance network info cache due to event network-changed-068c4e66-773c-4192-ab91-664b48a5fe9e. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ab82ab2b-0a93-4a1c-a4d8-66c61ff6df9b req-a4dc2a9e-ee1d-4b0c-a5e4-70b5c05e6c49 service nova] Acquiring lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ab82ab2b-0a93-4a1c-a4d8-66c61ff6df9b req-a4dc2a9e-ee1d-4b0c-a5e4-70b5c05e6c49 service nova] Acquired lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG nova.network.neutron [req-ab82ab2b-0a93-4a1c-a4d8-66c61ff6df9b req-a4dc2a9e-ee1d-4b0c-a5e4-70b5c05e6c49 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Refreshing network info cache for port 068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG nova.network.neutron [req-ab82ab2b-0a93-4a1c-a4d8-66c61ff6df9b req-a4dc2a9e-ee1d-4b0c-a5e4-70b5c05e6c49 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updated VIF entry in instance network info cache for port 068c4e66-773c-4192-ab91-664b48a5fe9e. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG nova.network.neutron [req-ab82ab2b-0a93-4a1c-a4d8-66c61ff6df9b req-a4dc2a9e-ee1d-4b0c-a5e4-70b5c05e6c49 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating instance_info_cache with network_info: [{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ab82ab2b-0a93-4a1c-a4d8-66c61ff6df9b req-a4dc2a9e-ee1d-4b0c-a5e4-70b5c05e6c49 service nova] Releasing lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'flavor' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f94f994e-d202-47fb-8306-75a50e547d5b tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.936s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 -F raw /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk" returned: 0 in 2.283s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Ensure instance console log exists: /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Start _get_guest_xml network_info=[{"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c80fbca06e0d83b62cd5da425e2fcc98',container_format='bare',created_at=2023-08-01T08:26:09Z,direct_url=<?>,disk_format='qcow2',id=626ce0eb-0b53-4a9c-bec8-f21755becccd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-346930247-shelved',owner='9a4cff1bbd5247afa9ed2ddf4db11738',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T08:26:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:28:09 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:28:09 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c80fbca06e0d83b62cd5da425e2fcc98',container_format='bare',created_at=2023-08-01T08:26:09Z,direct_url=<?>,disk_format='qcow2',id=626ce0eb-0b53-4a9c-bec8-f21755becccd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-346930247-shelved',owner='9a4cff1bbd5247afa9ed2ddf4db11738',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T08:26:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'vcpu_model' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-346930247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-346930247',id=36,image_ref='626ce0eb-0b53-4a9c-bec8-f21755becccd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1856498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-08m57t5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member',shelved_at='2023-08-01T08:26:15.027023',shelved_host='user',shelved_image_id='626ce0eb-0b53-4a9c-bec8-f21755becccd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:28:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=468edb40-0972-4589-9395-826c1eeb0dc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'pci_devices' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:28:09 user nova-compute[72426]:   <uuid>468edb40-0972-4589-9395-826c1eeb0dc6</uuid>
Aug 01 08:28:09 user nova-compute[72426]:   <name>instance-00000024</name>
Aug 01 08:28:09 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:28:09 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:28:09 user nova-compute[72426]:   <metadata>
Aug 01 08:28:09 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:28:09 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:28:09 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-346930247</nova:name>
Aug 01 08:28:09 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:28:09</nova:creationTime>
Aug 01 08:28:09 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:28:09 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:28:09 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:28:09 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:28:09 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:28:09 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:28:09 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:28:09 user nova-compute[72426]:       <nova:owner>
Aug 01 08:28:09 user nova-compute[72426]:         <nova:user uuid="f32fed5c40f24c2086d59cbb61f93bea">tempest-AttachVolumeShelveTestJSON-1854691353-project-member</nova:user>
Aug 01 08:28:09 user nova-compute[72426]:         <nova:project uuid="9a4cff1bbd5247afa9ed2ddf4db11738">tempest-AttachVolumeShelveTestJSON-1854691353</nova:project>
Aug 01 08:28:09 user nova-compute[72426]:       </nova:owner>
Aug 01 08:28:09 user nova-compute[72426]:       <nova:root type="image" uuid="626ce0eb-0b53-4a9c-bec8-f21755becccd"/>
Aug 01 08:28:09 user nova-compute[72426]:       <nova:ports>
Aug 01 08:28:09 user nova-compute[72426]:         <nova:port uuid="f2a59028-82a7-4744-82f8-b9b0ec197596">
Aug 01 08:28:09 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 08:28:09 user nova-compute[72426]:         </nova:port>
Aug 01 08:28:09 user nova-compute[72426]:       </nova:ports>
Aug 01 08:28:09 user nova-compute[72426]:     </nova:instance>
Aug 01 08:28:09 user nova-compute[72426]:   </metadata>
Aug 01 08:28:09 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:28:09 user nova-compute[72426]:     <system>
Aug 01 08:28:09 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:28:09 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:28:09 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:28:09 user nova-compute[72426]:       <entry name="serial">468edb40-0972-4589-9395-826c1eeb0dc6</entry>
Aug 01 08:28:09 user nova-compute[72426]:       <entry name="uuid">468edb40-0972-4589-9395-826c1eeb0dc6</entry>
Aug 01 08:28:09 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:28:09 user nova-compute[72426]:     </system>
Aug 01 08:28:09 user nova-compute[72426]:   </sysinfo>
Aug 01 08:28:09 user nova-compute[72426]:   <os>
Aug 01 08:28:09 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:28:09 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:28:09 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:28:09 user nova-compute[72426]:   </os>
Aug 01 08:28:09 user nova-compute[72426]:   <features>
Aug 01 08:28:09 user nova-compute[72426]:     <acpi/>
Aug 01 08:28:09 user nova-compute[72426]:     <apic/>
Aug 01 08:28:09 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:28:09 user nova-compute[72426]:   </features>
Aug 01 08:28:09 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:28:09 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:28:09 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:28:09 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:28:09 user nova-compute[72426]:   </clock>
Aug 01 08:28:09 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:28:09 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:28:09 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:28:09 user nova-compute[72426]:   </cpu>
Aug 01 08:28:09 user nova-compute[72426]:   <devices>
Aug 01 08:28:09 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:28:09 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:28:09 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk"/>
Aug 01 08:28:09 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:28:09 user nova-compute[72426]:     </disk>
Aug 01 08:28:09 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:28:09 user nova-compute[72426]:       <mac address="fa:16:3e:52:24:c0"/>
Aug 01 08:28:09 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:28:09 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:28:09 user nova-compute[72426]:       <target dev="tapf2a59028-82"/>
Aug 01 08:28:09 user nova-compute[72426]:     </interface>
Aug 01 08:28:09 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:28:09 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/console.log" append="off"/>
Aug 01 08:28:09 user nova-compute[72426]:     </serial>
Aug 01 08:28:09 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:28:09 user nova-compute[72426]:     <video>
Aug 01 08:28:09 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:28:09 user nova-compute[72426]:     </video>
Aug 01 08:28:09 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:28:09 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:28:09 user nova-compute[72426]:     </rng>
Aug 01 08:28:09 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:28:09 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:28:09 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:28:09 user nova-compute[72426]:     </memballoon>
Aug 01 08:28:09 user nova-compute[72426]:   </devices>
Aug 01 08:28:09 user nova-compute[72426]: </domain>
Aug 01 08:28:09 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-346930247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-346930247',id=36,image_ref='626ce0eb-0b53-4a9c-bec8-f21755becccd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1856498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:24:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-08m57t5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member',shelved_at='2023-08-01T08:26:15.027023',shelved_host='user',shelved_image_id='626ce0eb-0b53-4a9c-bec8-f21755becccd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:28:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=468edb40-0972-4589-9395-826c1eeb0dc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG os_vif [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2a59028-82, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2a59028-82, col_values=(('external_ids', {'iface-id': 'f2a59028-82a7-4744-82f8-b9b0ec197596', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:24:c0', 'vm-uuid': '468edb40-0972-4589-9395-826c1eeb0dc6'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:09 user nova-compute[72426]: INFO os_vif [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82')
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:28:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] No VIF found with MAC fa:16:3e:52:24:c0, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:28:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-252daa1e-4623-4e7a-94a6-08856ab7b328 req-f36bd65b-02e6-41a5-a005-cbdd2a8c0232 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-252daa1e-4623-4e7a-94a6-08856ab7b328 req-f36bd65b-02e6-41a5-a005-cbdd2a8c0232 service nova] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-252daa1e-4623-4e7a-94a6-08856ab7b328 req-f36bd65b-02e6-41a5-a005-cbdd2a8c0232 service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-252daa1e-4623-4e7a-94a6-08856ab7b328 req-f36bd65b-02e6-41a5-a005-cbdd2a8c0232 service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:11 user nova-compute[72426]: DEBUG nova.compute.manager [req-252daa1e-4623-4e7a-94a6-08856ab7b328 req-f36bd65b-02e6-41a5-a005-cbdd2a8c0232 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] No waiting events found dispatching network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:11 user nova-compute[72426]: WARNING nova.compute.manager [req-252daa1e-4623-4e7a-94a6-08856ab7b328 req-f36bd65b-02e6-41a5-a005-cbdd2a8c0232 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received unexpected event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 08:28:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:11 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878476.72209, 9a381085-5df7-453e-8631-995ab647cabe => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:28:11 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 9a381085-5df7-453e-8631-995ab647cabe] VM Stopped (Lifecycle Event)
Aug 01 08:28:11 user nova-compute[72426]: DEBUG nova.compute.manager [None req-0e7ff725-fb3f-4250-aab5-f29b00335487 None None] [instance: 9a381085-5df7-453e-8631-995ab647cabe] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:28:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878493.0594804, 468edb40-0972-4589-9395-826c1eeb0dc6 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:28:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] VM Resumed (Lifecycle Event)
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:28:13 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Instance spawned successfully.
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:28:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878493.0621417, 468edb40-0972-4589-9395-826c1eeb0dc6 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:28:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] VM Started (Lifecycle Event)
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:28:13 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-a8bf6ef7-909e-40c7-ad24-0bfcbdd27227 req-eccb71b2-389a-4128-99dc-856455cf7856 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a8bf6ef7-909e-40c7-ad24-0bfcbdd27227 req-eccb71b2-389a-4128-99dc-856455cf7856 service nova] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a8bf6ef7-909e-40c7-ad24-0bfcbdd27227 req-eccb71b2-389a-4128-99dc-856455cf7856 service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a8bf6ef7-909e-40c7-ad24-0bfcbdd27227 req-eccb71b2-389a-4128-99dc-856455cf7856 service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:13 user nova-compute[72426]: DEBUG nova.compute.manager [req-a8bf6ef7-909e-40c7-ad24-0bfcbdd27227 req-eccb71b2-389a-4128-99dc-856455cf7856 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] No waiting events found dispatching network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:13 user nova-compute[72426]: WARNING nova.compute.manager [req-a8bf6ef7-909e-40c7-ad24-0bfcbdd27227 req-eccb71b2-389a-4128-99dc-856455cf7856 service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received unexpected event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 08:28:13 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2e5e2a89-a747-4740-865a-6c785ffcbbed tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "468edb40-0972-4589-9395-826c1eeb0dc6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.756s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "c10d6140-aa17-4342-9135-d07a73285483" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "c10d6140-aa17-4342-9135-d07a73285483" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "c10d6140-aa17-4342-9135-d07a73285483-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "c10d6140-aa17-4342-9135-d07a73285483-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "c10d6140-aa17-4342-9135-d07a73285483-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:17 user nova-compute[72426]: INFO nova.compute.manager [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Terminating instance
Aug 01 08:28:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG nova.compute.manager [req-eb0f7f00-6ada-454c-8e4e-a5eb318d363e req-7145e410-1ef1-4c41-bd52-d4c6f2e668d2 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Received event network-vif-unplugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-eb0f7f00-6ada-454c-8e4e-a5eb318d363e req-7145e410-1ef1-4c41-bd52-d4c6f2e668d2 service nova] Acquiring lock "c10d6140-aa17-4342-9135-d07a73285483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-eb0f7f00-6ada-454c-8e4e-a5eb318d363e req-7145e410-1ef1-4c41-bd52-d4c6f2e668d2 service nova] Lock "c10d6140-aa17-4342-9135-d07a73285483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-eb0f7f00-6ada-454c-8e4e-a5eb318d363e req-7145e410-1ef1-4c41-bd52-d4c6f2e668d2 service nova] Lock "c10d6140-aa17-4342-9135-d07a73285483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG nova.compute.manager [req-eb0f7f00-6ada-454c-8e4e-a5eb318d363e req-7145e410-1ef1-4c41-bd52-d4c6f2e668d2 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] No waiting events found dispatching network-vif-unplugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG nova.compute.manager [req-eb0f7f00-6ada-454c-8e4e-a5eb318d363e req-7145e410-1ef1-4c41-bd52-d4c6f2e668d2 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Received event network-vif-unplugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:17 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: c10d6140-aa17-4342-9135-d07a73285483] Instance destroyed successfully.
Aug 01 08:28:17 user nova-compute[72426]: DEBUG nova.objects.instance [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lazy-loading 'resources' on Instance uuid c10d6140-aa17-4342-9135-d07a73285483 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334645290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-334645290',id=2,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0b6971ed0a343468f071e1e25c27d5b',ramdisk_id='',reservation_id='r-n09a5vh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:10:34Z,user_data=None,user_id='184d71425948492e835ea8f0dd857d1f',uuid=c10d6140-aa17-4342-9135-d07a73285483,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converting VIF {"id": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "address": "fa:16:3e:ef:a2:b8", "network": {"id": "98a29591-ecab-4521-98a9-ab0c9c17a301", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-233358634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0b6971ed0a343468f071e1e25c27d5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ea1e7a-7a", "ovs_interfaceid": "48ea1e7a-7adf-4836-bed4-5de3edd22ac1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=48ea1e7a-7adf-4836-bed4-5de3edd22ac1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ea1e7a-7a') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG os_vif [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=48ea1e7a-7adf-4836-bed4-5de3edd22ac1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ea1e7a-7a') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48ea1e7a-7a, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:17 user nova-compute[72426]: INFO os_vif [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=48ea1e7a-7adf-4836-bed4-5de3edd22ac1,network=Network(98a29591-ecab-4521-98a9-ab0c9c17a301),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ea1e7a-7a')
Aug 01 08:28:17 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Deleting instance files /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483_del
Aug 01 08:28:17 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Deletion of /opt/stack/data/nova/instances/c10d6140-aa17-4342-9135-d07a73285483_del complete
Aug 01 08:28:17 user nova-compute[72426]: INFO nova.compute.manager [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] [instance: c10d6140-aa17-4342-9135-d07a73285483] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 08:28:17 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: c10d6140-aa17-4342-9135-d07a73285483] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:28:17 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: c10d6140-aa17-4342-9135-d07a73285483] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:28:18 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-24719a19-8b07-4c72-b839-3e742a485b16 req-88a82d5b-f80d-4623-95bb-52410c82854d service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Received event network-vif-deleted-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:18 user nova-compute[72426]: INFO nova.compute.manager [req-24719a19-8b07-4c72-b839-3e742a485b16 req-88a82d5b-f80d-4623-95bb-52410c82854d service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Neutron deleted interface 48ea1e7a-7adf-4836-bed4-5de3edd22ac1; detaching it from the instance and deleting it from the info cache
Aug 01 08:28:18 user nova-compute[72426]: DEBUG nova.network.neutron [req-24719a19-8b07-4c72-b839-3e742a485b16 req-88a82d5b-f80d-4623-95bb-52410c82854d service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:18 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: c10d6140-aa17-4342-9135-d07a73285483] Took 0.56 seconds to deallocate network for instance.
Aug 01 08:28:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-24719a19-8b07-4c72-b839-3e742a485b16 req-88a82d5b-f80d-4623-95bb-52410c82854d service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Detach interface failed, port_id=48ea1e7a-7adf-4836-bed4-5de3edd22ac1, reason: Instance c10d6140-aa17-4342-9135-d07a73285483 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:28:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:18 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:28:18 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:28:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:18 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Deleted allocations for instance c10d6140-aa17-4342-9135-d07a73285483
Aug 01 08:28:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-e7bf4dfa-d223-4d53-9dfe-facc30031ef4 tempest-ServerBootFromVolumeStableRescueTest-2030640431 tempest-ServerBootFromVolumeStableRescueTest-2030640431-project-member] Lock "c10d6140-aa17-4342-9135-d07a73285483" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:28:19 user nova-compute[72426]: INFO nova.compute.claims [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Claim successful on node user
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.compute.manager [req-99552bb2-f789-4ddf-9aa3-de3c6f40ad11 req-61e650a3-a272-4220-98d3-e04ecd1f8980 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Received event network-vif-plugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-99552bb2-f789-4ddf-9aa3-de3c6f40ad11 req-61e650a3-a272-4220-98d3-e04ecd1f8980 service nova] Acquiring lock "c10d6140-aa17-4342-9135-d07a73285483-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-99552bb2-f789-4ddf-9aa3-de3c6f40ad11 req-61e650a3-a272-4220-98d3-e04ecd1f8980 service nova] Lock "c10d6140-aa17-4342-9135-d07a73285483-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-99552bb2-f789-4ddf-9aa3-de3c6f40ad11 req-61e650a3-a272-4220-98d3-e04ecd1f8980 service nova] Lock "c10d6140-aa17-4342-9135-d07a73285483-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.compute.manager [req-99552bb2-f789-4ddf-9aa3-de3c6f40ad11 req-61e650a3-a272-4220-98d3-e04ecd1f8980 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] No waiting events found dispatching network-vif-plugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:19 user nova-compute[72426]: WARNING nova.compute.manager [req-99552bb2-f789-4ddf-9aa3-de3c6f40ad11 req-61e650a3-a272-4220-98d3-e04ecd1f8980 service nova] [instance: c10d6140-aa17-4342-9135-d07a73285483] Received unexpected event network-vif-plugged-48ea1e7a-7adf-4836-bed4-5de3edd22ac1 for instance with vm_state deleted and task_state None.
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.network.neutron [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:28:19 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.policy [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aab05095eb5347ea9f7e4f7bf33a089a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d025ba4c824773bbeedb7981910a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:28:19 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Creating image(s)
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "/opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "/opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.181s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk 1073741824" returned: 0 in 0.056s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG nova.network.neutron [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Successfully created port: cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Cannot resize image /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG nova.objects.instance [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'migration_context' on Instance uuid 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Ensure instance console log exists: /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Successfully updated port: cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "refresh_cache-0ca54a63-b572-4d42-986d-7fc2db52e958" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquired lock "refresh_cache-0ca54a63-b572-4d42-986d-7fc2db52e958" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-ae94ba7f-369b-4413-b8aa-bdf2d36fc402 req-f5e4f378-93fa-4659-ae16-f431ba9bd34c service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received event network-changed-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-ae94ba7f-369b-4413-b8aa-bdf2d36fc402 req-f5e4f378-93fa-4659-ae16-f431ba9bd34c service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Refreshing instance network info cache due to event network-changed-cdc95aa7-0549-4046-8237-b0b98ec1f3cf. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ae94ba7f-369b-4413-b8aa-bdf2d36fc402 req-f5e4f378-93fa-4659-ae16-f431ba9bd34c service nova] Acquiring lock "refresh_cache-0ca54a63-b572-4d42-986d-7fc2db52e958" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Updating instance_info_cache with network_info: [{"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Releasing lock "refresh_cache-0ca54a63-b572-4d42-986d-7fc2db52e958" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.compute.manager [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Instance network_info: |[{"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ae94ba7f-369b-4413-b8aa-bdf2d36fc402 req-f5e4f378-93fa-4659-ae16-f431ba9bd34c service nova] Acquired lock "refresh_cache-0ca54a63-b572-4d42-986d-7fc2db52e958" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.network.neutron [req-ae94ba7f-369b-4413-b8aa-bdf2d36fc402 req-f5e4f378-93fa-4659-ae16-f431ba9bd34c service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Refreshing network info cache for port cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Start _get_guest_xml network_info=[{"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:28:21 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:28:21 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:28:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-204684804',display_name='tempest-AttachVolumeTestJSON-server-204684804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-204684804',id=42,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmYQr8lV6VgvhjbdlQeRLdT8FWRE1pSJ/WKFSLqVOy+plCj5kAykNauHsE/RW2W5tNnOgVElEamZsymDpxWbMYBVmv9txI2M6g7jvOTXeAHO1K96VTV9U4o9EqJ2atMbA==',key_name='tempest-keypair-1214289459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-0jxvu3ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:28:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=0ca54a63-b572-4d42-986d-7fc2db52e958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d2:7d,bridge_name='br-int',has_traffic_filtering=True,id=cdc95aa7-0549-4046-8237-b0b98ec1f3cf,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc95aa7-05') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.objects.instance [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:28:21 user nova-compute[72426]:   <uuid>0ca54a63-b572-4d42-986d-7fc2db52e958</uuid>
Aug 01 08:28:21 user nova-compute[72426]:   <name>instance-0000002a</name>
Aug 01 08:28:21 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:28:21 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:28:21 user nova-compute[72426]:   <metadata>
Aug 01 08:28:21 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:28:21 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:28:21 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeTestJSON-server-204684804</nova:name>
Aug 01 08:28:21 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:28:21</nova:creationTime>
Aug 01 08:28:21 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:28:21 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:28:21 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:28:21 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:28:21 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:28:21 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:28:21 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:28:21 user nova-compute[72426]:       <nova:owner>
Aug 01 08:28:21 user nova-compute[72426]:         <nova:user uuid="aab05095eb5347ea9f7e4f7bf33a089a">tempest-AttachVolumeTestJSON-173754033-project-member</nova:user>
Aug 01 08:28:21 user nova-compute[72426]:         <nova:project uuid="f4d025ba4c824773bbeedb7981910a9a">tempest-AttachVolumeTestJSON-173754033</nova:project>
Aug 01 08:28:21 user nova-compute[72426]:       </nova:owner>
Aug 01 08:28:21 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:28:21 user nova-compute[72426]:       <nova:ports>
Aug 01 08:28:21 user nova-compute[72426]:         <nova:port uuid="cdc95aa7-0549-4046-8237-b0b98ec1f3cf">
Aug 01 08:28:21 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 08:28:21 user nova-compute[72426]:         </nova:port>
Aug 01 08:28:21 user nova-compute[72426]:       </nova:ports>
Aug 01 08:28:21 user nova-compute[72426]:     </nova:instance>
Aug 01 08:28:21 user nova-compute[72426]:   </metadata>
Aug 01 08:28:21 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:28:21 user nova-compute[72426]:     <system>
Aug 01 08:28:21 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:28:21 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:28:21 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:28:21 user nova-compute[72426]:       <entry name="serial">0ca54a63-b572-4d42-986d-7fc2db52e958</entry>
Aug 01 08:28:21 user nova-compute[72426]:       <entry name="uuid">0ca54a63-b572-4d42-986d-7fc2db52e958</entry>
Aug 01 08:28:21 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:28:21 user nova-compute[72426]:     </system>
Aug 01 08:28:21 user nova-compute[72426]:   </sysinfo>
Aug 01 08:28:21 user nova-compute[72426]:   <os>
Aug 01 08:28:21 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:28:21 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:28:21 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:28:21 user nova-compute[72426]:   </os>
Aug 01 08:28:21 user nova-compute[72426]:   <features>
Aug 01 08:28:21 user nova-compute[72426]:     <acpi/>
Aug 01 08:28:21 user nova-compute[72426]:     <apic/>
Aug 01 08:28:21 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:28:21 user nova-compute[72426]:   </features>
Aug 01 08:28:21 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:28:21 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:28:21 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:28:21 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:28:21 user nova-compute[72426]:   </clock>
Aug 01 08:28:21 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:28:21 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:28:21 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:28:21 user nova-compute[72426]:   </cpu>
Aug 01 08:28:21 user nova-compute[72426]:   <devices>
Aug 01 08:28:21 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:28:21 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:28:21 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk"/>
Aug 01 08:28:21 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:28:21 user nova-compute[72426]:     </disk>
Aug 01 08:28:21 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:28:21 user nova-compute[72426]:       <mac address="fa:16:3e:fb:d2:7d"/>
Aug 01 08:28:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:28:21 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:28:21 user nova-compute[72426]:       <target dev="tapcdc95aa7-05"/>
Aug 01 08:28:21 user nova-compute[72426]:     </interface>
Aug 01 08:28:21 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:28:21 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/console.log" append="off"/>
Aug 01 08:28:21 user nova-compute[72426]:     </serial>
Aug 01 08:28:21 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:28:21 user nova-compute[72426]:     <video>
Aug 01 08:28:21 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:28:21 user nova-compute[72426]:     </video>
Aug 01 08:28:21 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:28:21 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:28:21 user nova-compute[72426]:     </rng>
Aug 01 08:28:21 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:28:21 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:28:21 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:28:21 user nova-compute[72426]:     </memballoon>
Aug 01 08:28:21 user nova-compute[72426]:   </devices>
Aug 01 08:28:21 user nova-compute[72426]: </domain>
Aug 01 08:28:21 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:28:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-204684804',display_name='tempest-AttachVolumeTestJSON-server-204684804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-204684804',id=42,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmYQr8lV6VgvhjbdlQeRLdT8FWRE1pSJ/WKFSLqVOy+plCj5kAykNauHsE/RW2W5tNnOgVElEamZsymDpxWbMYBVmv9txI2M6g7jvOTXeAHO1K96VTV9U4o9EqJ2atMbA==',key_name='tempest-keypair-1214289459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-0jxvu3ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:28:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=0ca54a63-b572-4d42-986d-7fc2db52e958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d2:7d,bridge_name='br-int',has_traffic_filtering=True,id=cdc95aa7-0549-4046-8237-b0b98ec1f3cf,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc95aa7-05') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG os_vif [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d2:7d,bridge_name='br-int',has_traffic_filtering=True,id=cdc95aa7-0549-4046-8237-b0b98ec1f3cf,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc95aa7-05') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdc95aa7-05, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcdc95aa7-05, col_values=(('external_ids', {'iface-id': 'cdc95aa7-0549-4046-8237-b0b98ec1f3cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:d2:7d', 'vm-uuid': '0ca54a63-b572-4d42-986d-7fc2db52e958'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:21 user nova-compute[72426]: INFO os_vif [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:d2:7d,bridge_name='br-int',has_traffic_filtering=True,id=cdc95aa7-0549-4046-8237-b0b98ec1f3cf,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc95aa7-05')
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:28:21 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No VIF found with MAC fa:16:3e:fb:d2:7d, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:28:22 user nova-compute[72426]: DEBUG nova.network.neutron [req-ae94ba7f-369b-4413-b8aa-bdf2d36fc402 req-f5e4f378-93fa-4659-ae16-f431ba9bd34c service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Updated VIF entry in instance network info cache for port cdc95aa7-0549-4046-8237-b0b98ec1f3cf. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:28:22 user nova-compute[72426]: DEBUG nova.network.neutron [req-ae94ba7f-369b-4413-b8aa-bdf2d36fc402 req-f5e4f378-93fa-4659-ae16-f431ba9bd34c service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Updating instance_info_cache with network_info: [{"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ae94ba7f-369b-4413-b8aa-bdf2d36fc402 req-f5e4f378-93fa-4659-ae16-f431ba9bd34c service nova] Releasing lock "refresh_cache-0ca54a63-b572-4d42-986d-7fc2db52e958" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:28:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-461bb1aa-1f7a-458a-815d-bc657f62dc12 req-b2807bc7-831f-4030-894d-17a13edf73dc service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received event network-vif-plugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-461bb1aa-1f7a-458a-815d-bc657f62dc12 req-b2807bc7-831f-4030-894d-17a13edf73dc service nova] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-461bb1aa-1f7a-458a-815d-bc657f62dc12 req-b2807bc7-831f-4030-894d-17a13edf73dc service nova] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-461bb1aa-1f7a-458a-815d-bc657f62dc12 req-b2807bc7-831f-4030-894d-17a13edf73dc service nova] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-461bb1aa-1f7a-458a-815d-bc657f62dc12 req-b2807bc7-831f-4030-894d-17a13edf73dc service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] No waiting events found dispatching network-vif-plugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:23 user nova-compute[72426]: WARNING nova.compute.manager [req-461bb1aa-1f7a-458a-815d-bc657f62dc12 req-b2807bc7-831f-4030-894d-17a13edf73dc service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received unexpected event network-vif-plugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf for instance with vm_state building and task_state spawning.
Aug 01 08:28:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878505.2072873, 0ca54a63-b572-4d42-986d-7fc2db52e958 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:28:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] VM Resumed (Lifecycle Event)
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:28:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Instance spawned successfully.
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:28:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878505.2074008, 0ca54a63-b572-4d42-986d-7fc2db52e958 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:28:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] VM Started (Lifecycle Event)
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:28:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:28:25 user nova-compute[72426]: INFO nova.compute.manager [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-cbafb254-f7f7-4b12-bbe6-cd66963afbee req-a169687d-e39f-4214-aa45-d9d051d339b6 service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received event network-vif-plugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cbafb254-f7f7-4b12-bbe6-cd66963afbee req-a169687d-e39f-4214-aa45-d9d051d339b6 service nova] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cbafb254-f7f7-4b12-bbe6-cd66963afbee req-a169687d-e39f-4214-aa45-d9d051d339b6 service nova] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cbafb254-f7f7-4b12-bbe6-cd66963afbee req-a169687d-e39f-4214-aa45-d9d051d339b6 service nova] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-cbafb254-f7f7-4b12-bbe6-cd66963afbee req-a169687d-e39f-4214-aa45-d9d051d339b6 service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] No waiting events found dispatching network-vif-plugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:25 user nova-compute[72426]: WARNING nova.compute.manager [req-cbafb254-f7f7-4b12-bbe6-cd66963afbee req-a169687d-e39f-4214-aa45-d9d051d339b6 service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received unexpected event network-vif-plugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf for instance with vm_state building and task_state spawning.
Aug 01 08:28:25 user nova-compute[72426]: INFO nova.compute.manager [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Took 6.13 seconds to build instance.
Aug 01 08:28:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-40992ee1-637f-4051-9651-093b788f4535 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.224s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878497.8401868, c10d6140-aa17-4342-9135-d07a73285483 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:28:32 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: c10d6140-aa17-4342-9135-d07a73285483] VM Stopped (Lifecycle Event)
Aug 01 08:28:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9e6350a8-b6a7-4dc4-82e1-a43a454efa45 None None] [instance: c10d6140-aa17-4342-9135-d07a73285483] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:36 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:28:36 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7273MB free_disk=25.128185272216797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 37dab412-5a15-46e8-844e-2ef0c03b7181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance c707f931-d77d-44c8-a352-49e673ff6c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 8fff7c8e-8129-40f3-ac3b-9b60408705ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 1307ee99-42c0-4086-b8b1-120630450f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 468edb40-0972-4589-9395-826c1eeb0dc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0ca54a63-b572-4d42-986d-7fc2db52e958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-d403460b-8c0a-4bb3-8eae-032225da7cad req-6154373e-2052-45cc-bdc7-2e5b350457cf service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received event network-changed-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-d403460b-8c0a-4bb3-8eae-032225da7cad req-6154373e-2052-45cc-bdc7-2e5b350457cf service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Refreshing instance network info cache due to event network-changed-8c6e8110-5538-45f1-84f0-ad575bd36538. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d403460b-8c0a-4bb3-8eae-032225da7cad req-6154373e-2052-45cc-bdc7-2e5b350457cf service nova] Acquiring lock "refresh_cache-46dc65bb-be41-48c9-9ffe-513d60afa9c0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d403460b-8c0a-4bb3-8eae-032225da7cad req-6154373e-2052-45cc-bdc7-2e5b350457cf service nova] Acquired lock "refresh_cache-46dc65bb-be41-48c9-9ffe-513d60afa9c0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG nova.network.neutron [req-d403460b-8c0a-4bb3-8eae-032225da7cad req-6154373e-2052-45cc-bdc7-2e5b350457cf service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Refreshing network info cache for port 8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG nova.network.neutron [req-d403460b-8c0a-4bb3-8eae-032225da7cad req-6154373e-2052-45cc-bdc7-2e5b350457cf service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Updated VIF entry in instance network info cache for port 8c6e8110-5538-45f1-84f0-ad575bd36538. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG nova.network.neutron [req-d403460b-8c0a-4bb3-8eae-032225da7cad req-6154373e-2052-45cc-bdc7-2e5b350457cf service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Updating instance_info_cache with network_info: [{"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d403460b-8c0a-4bb3-8eae-032225da7cad req-6154373e-2052-45cc-bdc7-2e5b350457cf service nova] Releasing lock "refresh_cache-46dc65bb-be41-48c9-9ffe-513d60afa9c0" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG nova.objects.instance [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lazy-loading 'flavor' on Instance uuid 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:39 user nova-compute[72426]: INFO nova.compute.manager [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Attaching volume a86f19d1-7bcb-4e96-a84d-f129f7a3843e to /dev/vdb
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG os_brick.utils [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81245ce-ce32-4294-8274-5e8afcac80c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f15112c-803d-419f-851a-1d6727af6665]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5813e588-000a-4153-87d0-fdce6b89a69c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced93802-bf88-48cd-8245-1adbfd6f4af2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:28:39 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:28:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a51f71-859a-44a5-9ba5-4926fcdd21b1]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG os_brick.utils [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:28:39 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Updating existing volume attachment record: 6cf125e3-9ea0-4bef-bc0e-ed7c58a4b767 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:28:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating instance_info_cache with network_info: [{"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-c707f931-d77d-44c8-a352-49e673ff6c0b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:28:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:28:41 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:28:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:28:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:28:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:43 user nova-compute[72426]: INFO nova.compute.manager [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Terminating instance
Aug 01 08:28:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-8d7de89f-ebf1-4318-a0ca-f8cebee0dc9b req-931e8adb-1e7a-4a00-8d5a-9a00f75b7ae6 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-unplugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8d7de89f-ebf1-4318-a0ca-f8cebee0dc9b req-931e8adb-1e7a-4a00-8d5a-9a00f75b7ae6 service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8d7de89f-ebf1-4318-a0ca-f8cebee0dc9b req-931e8adb-1e7a-4a00-8d5a-9a00f75b7ae6 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8d7de89f-ebf1-4318-a0ca-f8cebee0dc9b req-931e8adb-1e7a-4a00-8d5a-9a00f75b7ae6 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-8d7de89f-ebf1-4318-a0ca-f8cebee0dc9b req-931e8adb-1e7a-4a00-8d5a-9a00f75b7ae6 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-unplugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-8d7de89f-ebf1-4318-a0ca-f8cebee0dc9b req-931e8adb-1e7a-4a00-8d5a-9a00f75b7ae6 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-unplugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Instance destroyed successfully.
Aug 01 08:28:44 user nova-compute[72426]: DEBUG nova.objects.instance [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lazy-loading 'resources' on Instance uuid bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-713742802',display_name='tempest-TestMinimumBasicScenario-server-713742802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-713742802',id=35,image_ref='5f3d6662-bb1e-4878-9dae-d93bf4d642f7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9cZsXgLKIFvJtPur+0xMN2AHirOZy+Uxlt6KnLj3FvFu1sI2/MGyLmoimBizhW7oGZNQgC+4yujZSgtPVyAD4iJ1ol27Qxotbm1/GPaQ/JgkjKgHPubz/QKEhNLMtDYg==',key_name='tempest-TestMinimumBasicScenario-50015426',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:23:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85beb29b81c84c9bb0b49c8bdb107d50',ramdisk_id='',reservation_id='r-209t74tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f3d6662-bb1e-4878-9dae-d93bf4d642f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-307605778',owner_user_name='tempest-TestMinimumBasicScenario-307605778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:26:03Z,user_data=None,user_id='46cce858652440719bed7e5473ffb18d',uuid=bb481b39-3c20-48f5-ad4a-0b755e9ca9f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converting VIF {"id": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "address": "fa:16:3e:21:be:c4", "network": {"id": "6d4fd2d0-8919-439a-8b2d-8d431eb0ccda", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-578210125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85beb29b81c84c9bb0b49c8bdb107d50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1705fdbb-58", "ovs_interfaceid": "1705fdbb-5832-4b95-8bde-3ba0de7a4f34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:be:c4,bridge_name='br-int',has_traffic_filtering=True,id=1705fdbb-5832-4b95-8bde-3ba0de7a4f34,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1705fdbb-58') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG os_vif [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:be:c4,bridge_name='br-int',has_traffic_filtering=True,id=1705fdbb-5832-4b95-8bde-3ba0de7a4f34,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1705fdbb-58') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1705fdbb-58, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:28:44 user nova-compute[72426]: INFO os_vif [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:be:c4,bridge_name='br-int',has_traffic_filtering=True,id=1705fdbb-5832-4b95-8bde-3ba0de7a4f34,network=Network(6d4fd2d0-8919-439a-8b2d-8d431eb0ccda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1705fdbb-58')
Aug 01 08:28:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Deleting instance files /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8_del
Aug 01 08:28:44 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Deletion of /opt/stack/data/nova/instances/bb481b39-3c20-48f5-ad4a-0b755e9ca9f8_del complete
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:44 user nova-compute[72426]: INFO nova.compute.manager [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 01 08:28:44 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:45 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Took 0.64 seconds to deallocate network for instance.
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-1b62850b-81a6-4d37-8d71-abf03bd75e9e req-e83a75d5-c11b-4421-8945-6d64fbdd1bde service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-deleted-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:45 user nova-compute[72426]: INFO nova.compute.manager [req-1b62850b-81a6-4d37-8d71-abf03bd75e9e req-e83a75d5-c11b-4421-8945-6d64fbdd1bde service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Neutron deleted interface 1705fdbb-5832-4b95-8bde-3ba0de7a4f34; detaching it from the instance and deleting it from the info cache
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.network.neutron [req-1b62850b-81a6-4d37-8d71-abf03bd75e9e req-e83a75d5-c11b-4421-8945-6d64fbdd1bde service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-1b62850b-81a6-4d37-8d71-abf03bd75e9e req-e83a75d5-c11b-4421-8945-6d64fbdd1bde service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Detach interface failed, port_id=1705fdbb-5832-4b95-8bde-3ba0de7a4f34, reason: Instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:45 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Deleted allocations for instance bb481b39-3c20-48f5-ad4a-0b755e9ca9f8
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16e1c94f-6f6a-4981-a658-df0d02b2f73d tempest-TestMinimumBasicScenario-307605778 tempest-TestMinimumBasicScenario-307605778-project-member] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:45 user nova-compute[72426]: WARNING nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received unexpected event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with vm_state deleted and task_state None.
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:45 user nova-compute[72426]: WARNING nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received unexpected event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with vm_state deleted and task_state None.
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:45 user nova-compute[72426]: WARNING nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received unexpected event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with vm_state deleted and task_state None.
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Acquiring lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] Lock "bb481b39-3c20-48f5-ad4a-0b755e9ca9f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] No waiting events found dispatching network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:45 user nova-compute[72426]: WARNING nova.compute.manager [req-8ab1980a-99bd-412d-b72e-245a05f0d30f req-87bccad1-d00e-43d6-9f0f-e0e3fd9b5aa3 service nova] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Received unexpected event network-vif-plugged-1705fdbb-5832-4b95-8bde-3ba0de7a4f34 for instance with vm_state deleted and task_state None.
Aug 01 08:28:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfzjwcTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:28:47 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:28:47 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:28:47 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6ea36c-17f7-4856-97e6-6ba235d9a4d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:28:47 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f06522-46f7-4b08-8d20-3f5cad6501bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e] added
Aug 01 08:28:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b62ff1d-820a-4fad-b6c0-417babfcd740]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c72867-6572-4145-afb5-83cf733b478c]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfzjwcTr {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfzjwcTr" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f0ee9c-0fbd-40b8-82da-c92086d68e61]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WfzjwcTr'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c407d6-aad1-45c6-ab77-768aafa5a06f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b662e4b0-e68d-40a0-ae39-a1d309122ed0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:28:47 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:28:47 user nova-compute[72426]:  {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:28:47 user nova-compute[72426]: WARNING os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 08:28:47 user nova-compute[72426]: 
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fed12b-e645-4df0-aeae-ce362372fa7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e, portal: 172.16.0.220,3260]
Aug 01 08:28:47 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e, portal: 172.16.0.220,3260] successful.
Aug 01 08:28:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[28debafa-d342-4757-abea-3fcee0e7f0ac]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7daece-6bfa-4472-8ecd-d9694fe93424]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:28:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:28:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[37830158-2cf6-42e0-b073-d79cf7797677]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:28:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfzjwcTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:28:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:28:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26138623838633763', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:28:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138623838633763', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:28:48 user nova-compute[72426]: DEBUG nova.objects.instance [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lazy-loading 'flavor' on Instance uuid 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:28:48 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:28:48 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:28:48 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:28:48 user nova-compute[72426]:   <serial>a86f19d1-7bcb-4e96-a84d-f129f7a3843e</serial>
Aug 01 08:28:48 user nova-compute[72426]: </disk>
Aug 01 08:28:48 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] No VIF found with MAC fa:16:3e:d1:bd:41, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-3eea4c89-86e3-4584-a1d0-027747d311f7 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.992s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-b559e103-0dc0-4579-b3a4-75b10697723e req-326e57f4-400e-4dda-b0a3-32e579d14a84 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received event network-changed-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-b559e103-0dc0-4579-b3a4-75b10697723e req-326e57f4-400e-4dda-b0a3-32e579d14a84 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Refreshing instance network info cache due to event network-changed-95cc6db7-744d-477c-b1d4-31ed03169092. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b559e103-0dc0-4579-b3a4-75b10697723e req-326e57f4-400e-4dda-b0a3-32e579d14a84 service nova] Acquiring lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b559e103-0dc0-4579-b3a4-75b10697723e req-326e57f4-400e-4dda-b0a3-32e579d14a84 service nova] Acquired lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG nova.network.neutron [req-b559e103-0dc0-4579-b3a4-75b10697723e req-326e57f4-400e-4dda-b0a3-32e579d14a84 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Refreshing network info cache for port 95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:49 user nova-compute[72426]: INFO nova.compute.manager [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Terminating instance
Aug 01 08:28:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-b559e103-0dc0-4579-b3a4-75b10697723e req-326e57f4-400e-4dda-b0a3-32e579d14a84 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updated VIF entry in instance network info cache for port 95cc6db7-744d-477c-b1d4-31ed03169092. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-b559e103-0dc0-4579-b3a4-75b10697723e req-326e57f4-400e-4dda-b0a3-32e579d14a84 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updating instance_info_cache with network_info: [{"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b559e103-0dc0-4579-b3a4-75b10697723e req-326e57f4-400e-4dda-b0a3-32e579d14a84 service nova] Releasing lock "refresh_cache-37dab412-5a15-46e8-844e-2ef0c03b7181" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:28:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Instance destroyed successfully.
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.objects.instance [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lazy-loading 'resources' on Instance uuid 37dab412-5a15-46e8-844e-2ef0c03b7181 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:21:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1655660679',display_name='tempest-TestStampPattern-server-1655660679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1655660679',id=32,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzi07fWEZm9ZDpMiwLaYbjLSFJSACGngqPGH6IXGkKdZqaHEkFII80iFN525qE1V6pVTrPP41DJXrIqlOvHoD2AT4HCLJUUwmYLnWGEElwg4L0QUNN1qgp0PiMSAfYWeA==',key_name='tempest-TestStampPattern-721892585',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:21:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ff89c616cbd48e685d1d4330c874bb7',ramdisk_id='',reservation_id='r-yedwg8jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-936652585',owner_user_name='tempest-TestStampPattern-936652585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:24:49Z,user_data=None,user_id='56d58ffe9bad4d1fb35367ac0e60d181',uuid=37dab412-5a15-46e8-844e-2ef0c03b7181,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converting VIF {"id": "95cc6db7-744d-477c-b1d4-31ed03169092", "address": "fa:16:3e:bb:2f:46", "network": {"id": "f11cb61e-65b8-4c30-8e88-1a5d88a31cba", "bridge": "br-int", "label": "tempest-TestStampPattern-1043784278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ff89c616cbd48e685d1d4330c874bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95cc6db7-74", "ovs_interfaceid": "95cc6db7-744d-477c-b1d4-31ed03169092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:2f:46,bridge_name='br-int',has_traffic_filtering=True,id=95cc6db7-744d-477c-b1d4-31ed03169092,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc6db7-74') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG os_vif [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:2f:46,bridge_name='br-int',has_traffic_filtering=True,id=95cc6db7-744d-477c-b1d4-31ed03169092,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc6db7-74') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95cc6db7-74, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:28:50 user nova-compute[72426]: INFO os_vif [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:2f:46,bridge_name='br-int',has_traffic_filtering=True,id=95cc6db7-744d-477c-b1d4-31ed03169092,network=Network(f11cb61e-65b8-4c30-8e88-1a5d88a31cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95cc6db7-74')
Aug 01 08:28:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Deleting instance files /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181_del
Aug 01 08:28:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Deletion of /opt/stack/data/nova/instances/37dab412-5a15-46e8-844e-2ef0c03b7181_del complete
Aug 01 08:28:50 user nova-compute[72426]: INFO nova.compute.manager [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 08:28:50 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:50 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Took 0.58 seconds to deallocate network for instance.
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-1ac714ac-f8c6-4b4f-bddc-d9439f1eccbd req-5d227dbf-617d-4cad-86b3-e18b54d403e4 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received event network-vif-deleted-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:50 user nova-compute[72426]: INFO nova.compute.manager [req-1ac714ac-f8c6-4b4f-bddc-d9439f1eccbd req-5d227dbf-617d-4cad-86b3-e18b54d403e4 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Neutron deleted interface 95cc6db7-744d-477c-b1d4-31ed03169092; detaching it from the instance and deleting it from the info cache
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.network.neutron [req-1ac714ac-f8c6-4b4f-bddc-d9439f1eccbd req-5d227dbf-617d-4cad-86b3-e18b54d403e4 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-1ac714ac-f8c6-4b4f-bddc-d9439f1eccbd req-5d227dbf-617d-4cad-86b3-e18b54d403e4 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Detach interface failed, port_id=95cc6db7-744d-477c-b1d4-31ed03169092, reason: Instance 37dab412-5a15-46e8-844e-2ef0c03b7181 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:51 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Deleted allocations for instance 37dab412-5a15-46e8-844e-2ef0c03b7181
Aug 01 08:28:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-96b88039-e242-4c57-930d-3526374c0779 tempest-TestStampPattern-936652585 tempest-TestStampPattern-936652585-project-member] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received event network-vif-unplugged-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] No waiting events found dispatching network-vif-unplugged-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:51 user nova-compute[72426]: WARNING nova.compute.manager [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received unexpected event network-vif-unplugged-95cc6db7-744d-477c-b1d4-31ed03169092 for instance with vm_state deleted and task_state None.
Aug 01 08:28:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received event network-vif-plugged-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] Acquiring lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] Lock "37dab412-5a15-46e8-844e-2ef0c03b7181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] No waiting events found dispatching network-vif-plugged-95cc6db7-744d-477c-b1d4-31ed03169092 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:51 user nova-compute[72426]: WARNING nova.compute.manager [req-f0da60ea-592e-49d0-8d9d-9e3e5755c268 req-f09d9152-7678-4b3b-a6bb-3703dd3ad546 service nova] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Received unexpected event network-vif-plugged-95cc6db7-744d-477c-b1d4-31ed03169092 for instance with vm_state deleted and task_state None.
Aug 01 08:28:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG nova.objects.instance [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lazy-loading 'flavor' on Instance uuid 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:53 user nova-compute[72426]: INFO nova.compute.manager [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Attaching volume b68b3625-4a89-4bf4-b2f0-0ce4317400bc to /dev/vdc
Aug 01 08:28:53 user nova-compute[72426]: DEBUG os_brick.utils [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c27bc37-c472-48c2-892b-eb23521e2c24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a867d6a-799e-42c1-a9bd-7ab0b2a261f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6523867b-7d76-4b7b-980d-4f644abc160e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea64b5cc-d740-4537-96f2-caf74296caf9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:28:53 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:28:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b214342-0ef0-42b0-9a02-1d4ea2b76552]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG os_brick.utils [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:28:53 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Updating existing volume attachment record: dbc63be7-8404-4568-bc05-1345d73557a5 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:28:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:56 user nova-compute[72426]: INFO nova.compute.manager [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Terminating instance
Aug 01 08:28:56 user nova-compute[72426]: DEBUG nova.compute.manager [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:28:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-2f97cb16-e8cf-4d48-ac91-c2d7571d9cba req-8f2820b6-7c86-4238-aebe-ff75a3a75fc0 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-unplugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2f97cb16-e8cf-4d48-ac91-c2d7571d9cba req-8f2820b6-7c86-4238-aebe-ff75a3a75fc0 service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2f97cb16-e8cf-4d48-ac91-c2d7571d9cba req-8f2820b6-7c86-4238-aebe-ff75a3a75fc0 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2f97cb16-e8cf-4d48-ac91-c2d7571d9cba req-8f2820b6-7c86-4238-aebe-ff75a3a75fc0 service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-2f97cb16-e8cf-4d48-ac91-c2d7571d9cba req-8f2820b6-7c86-4238-aebe-ff75a3a75fc0 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-unplugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG nova.compute.manager [req-2f97cb16-e8cf-4d48-ac91-c2d7571d9cba req-8f2820b6-7c86-4238-aebe-ff75a3a75fc0 service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-unplugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:57 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Instance destroyed successfully.
Aug 01 08:28:57 user nova-compute[72426]: DEBUG nova.objects.instance [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'resources' on Instance uuid c707f931-d77d-44c8-a352-49e673ff6c0b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:22:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2113830838',display_name='tempest-ServerRescueNegativeTestJSON-server-2113830838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2113830838',id=34,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmtOi+bpc4SNJclltShPtVhZ2QLhLTJtvjPq0Y7w1K2KmdAkgHdbi/NZD+sFFRgCAHd0Mv5FbBE1+JKB4eeZ2wTuddjE5J4Z7huLigft3Un4MM8fMXHMUxilPaF6xAlCg==',key_name='tempest-keypair-1565746410',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-dsegwca3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e024ff90ae7148819d1d518d3754733f',uuid=c707f931-d77d-44c8-a352-49e673ff6c0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "068c4e66-773c-4192-ab91-664b48a5fe9e", "address": "fa:16:3e:e4:cd:30", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap068c4e66-77", "ovs_interfaceid": "068c4e66-773c-4192-ab91-664b48a5fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cd:30,bridge_name='br-int',has_traffic_filtering=True,id=068c4e66-773c-4192-ab91-664b48a5fe9e,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c4e66-77') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG os_vif [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cd:30,bridge_name='br-int',has_traffic_filtering=True,id=068c4e66-773c-4192-ab91-664b48a5fe9e,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c4e66-77') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap068c4e66-77, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:57 user nova-compute[72426]: INFO os_vif [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cd:30,bridge_name='br-int',has_traffic_filtering=True,id=068c4e66-773c-4192-ab91-664b48a5fe9e,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap068c4e66-77')
Aug 01 08:28:57 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Deleting instance files /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b_del
Aug 01 08:28:57 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Deletion of /opt/stack/data/nova/instances/c707f931-d77d-44c8-a352-49e673ff6c0b_del complete
Aug 01 08:28:57 user nova-compute[72426]: INFO nova.compute.manager [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 08:28:57 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:28:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:28:58 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:58 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Took 0.86 seconds to deallocate network for instance.
Aug 01 08:28:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-7f0e352a-06c4-4174-a5b3-3de0df692272 req-fdb4d722-f2ac-44e6-b2f7-b102353314ff service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-deleted-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:58 user nova-compute[72426]: INFO nova.compute.manager [req-7f0e352a-06c4-4174-a5b3-3de0df692272 req-fdb4d722-f2ac-44e6-b2f7-b102353314ff service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Neutron deleted interface 068c4e66-773c-4192-ab91-664b48a5fe9e; detaching it from the instance and deleting it from the info cache
Aug 01 08:28:58 user nova-compute[72426]: DEBUG nova.network.neutron [req-7f0e352a-06c4-4174-a5b3-3de0df692272 req-fdb4d722-f2ac-44e6-b2f7-b102353314ff service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:58 user nova-compute[72426]: DEBUG nova.compute.manager [req-7f0e352a-06c4-4174-a5b3-3de0df692272 req-fdb4d722-f2ac-44e6-b2f7-b102353314ff service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Detach interface failed, port_id=068c4e66-773c-4192-ab91-664b48a5fe9e, reason: Instance c707f931-d77d-44c8-a352-49e673ff6c0b could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:28:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:58 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:28:58 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:28:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:58 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Deleted allocations for instance c707f931-d77d-44c8-a352-49e673ff6c0b
Aug 01 08:28:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-370a1e02-40f2-4240-bb57-d7e2f07a9eef tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received event network-changed-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Refreshing instance network info cache due to event network-changed-0976b526-dfa9-4ba0-8156-047450df099c. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] Acquiring lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] Acquired lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG nova.network.neutron [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Refreshing network info cache for port 0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878524.334891, bb481b39-3c20-48f5-ad4a-0b755e9ca9f8 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:28:59 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] VM Stopped (Lifecycle Event)
Aug 01 08:28:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-62beb608-2619-4150-b733-a1b91d491587 None None] [instance: bb481b39-3c20-48f5-ad4a-0b755e9ca9f8] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG nova.network.neutron [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Updated VIF entry in instance network info cache for port 0976b526-dfa9-4ba0-8156-047450df099c. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG nova.network.neutron [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Updating instance_info_cache with network_info: [{"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] Releasing lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] Acquiring lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] Lock "c707f931-d77d-44c8-a352-49e673ff6c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:28:59 user nova-compute[72426]: DEBUG nova.compute.manager [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] No waiting events found dispatching network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:28:59 user nova-compute[72426]: WARNING nova.compute.manager [req-b8887570-22fc-42a3-97ec-ff8107441fc4 req-6ef824c7-1b8d-4180-8bd8-6e1f4d6e362e service nova] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Received unexpected event network-vif-plugged-068c4e66-773c-4192-ab91-664b48a5fe9e for instance with vm_state deleted and task_state None.
Aug 01 08:29:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "1307ee99-42c0-4086-b8b1-120630450f5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:00 user nova-compute[72426]: DEBUG nova.objects.instance [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'flavor' on Instance uuid 1307ee99-42c0-4086-b8b1-120630450f5c {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:29:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "1307ee99-42c0-4086-b8b1-120630450f5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:01 user nova-compute[72426]: INFO nova.compute.manager [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Attaching volume 1b0fb24a-a14d-468c-8719-78e48012688f to /dev/vdb
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.utils [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[14833453-644e-47f1-84f2-22332b31a47c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[15562bae-308b-4a0d-a1fe-b4563d5fb50c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[141ca7e1-dbcc-409e-add6-e5f2614c7fa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa22d5e7-3707-4d90-add0-085b837c8ae5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:29:01 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7451730a-1dc1-45a1-af0f-748774f38b61]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.utils [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Updating existing volume attachment record: 8d31d590-fe4e-463f-b86d-b0d364dd4e2a {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GowrxpKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:29:01 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:29:01 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:29:01 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf3f08c-e53e-4b03-a90c-3a721b2428cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:29:01 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b0aaf5-3cf5-47c2-b174-cf2d19e302d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc] added
Aug 01 08:29:01 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[322427b1-b994-4034-9596-15aee273f6c1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abb13fd-9073-461e-a8c4-5b7d6f427258]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GowrxpKD {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GowrxpKD" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f560ad-e642-471d-94f0-755a36a436fe]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GowrxpKD'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c68af9-6fad-4337-8ac7-b7feea4c229c]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6045a9b8-0954-42ae-95a8-f62606e7027f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:01 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:01 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c5fd3-abc5-4366-85cb-777158ba406c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc, portal: 172.16.0.220,3260]
Aug 01 08:29:01 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc, portal: 172.16.0.220,3260] successful.
Aug 01 08:29:01 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d7f70d-7380-42bd-a0b3-65f7eff5d1ca]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[453abeaa-dd3f-4194-ad35-2c2675de172b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:01 user nova-compute[72426]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc (non-flash)
Aug 01 08:29:01 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:01 user nova-compute[72426]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc (non-flash)
Aug 01 08:29:01 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebd4411-92d1-479b-b61d-788293168486]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:01 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:29:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:02 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:29:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GowrxpKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:29:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:29:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23038376632323930', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:29:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038376632323930', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:29:02 user nova-compute[72426]: DEBUG nova.objects.instance [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lazy-loading 'flavor' on Instance uuid 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:29:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:29:02 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:29:02 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:29:02 user nova-compute[72426]:   <target dev="vdc" bus="virtio"/>
Aug 01 08:29:02 user nova-compute[72426]:   <serial>b68b3625-4a89-4bf4-b2f0-0ce4317400bc</serial>
Aug 01 08:29:02 user nova-compute[72426]: </disk>
Aug 01 08:29:02 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:29:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:29:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:29:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:29:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] No VIF found with MAC fa:16:3e:d1:bd:41, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:29:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-16249c03-91c7-4caa-b94b-2fdc232f4165 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.685s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:04 user nova-compute[72426]: INFO nova.compute.manager [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Detaching volume b68b3625-4a89-4bf4-b2f0-0ce4317400bc
Aug 01 08:29:04 user nova-compute[72426]: INFO nova.virt.block_device [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Attempting to driver detach volume b68b3625-4a89-4bf4-b2f0-0ce4317400bc from mountpoint /dev/vdc
Aug 01 08:29:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Attempting to detach device vdc from instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:29:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:29:04 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:29:04 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:29:04 user nova-compute[72426]:   <target dev="vdc" bus="virtio"/>
Aug 01 08:29:04 user nova-compute[72426]:   <serial>b68b3625-4a89-4bf4-b2f0-0ce4317400bc</serial>
Aug 01 08:29:04 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 08:29:04 user nova-compute[72426]: </disk>
Aug 01 08:29:04 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:29:04 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Successfully detached device vdc from instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 from the persistent domain config.
Aug 01 08:29:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:29:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:29:04 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:29:04 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:29:04 user nova-compute[72426]:   <target dev="vdc" bus="virtio"/>
Aug 01 08:29:04 user nova-compute[72426]:   <serial>b68b3625-4a89-4bf4-b2f0-0ce4317400bc</serial>
Aug 01 08:29:04 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 08:29:04 user nova-compute[72426]: </disk>
Aug 01 08:29:04 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878545.183029, 46dc65bb-be41-48c9-9ffe-513d60afa9c0 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:29:05 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Successfully detached device vdc from instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 from the live domain config.
Aug 01 08:29:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GowrxpKD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:29:05 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd271d45-efce-45a4-b17f-2bb1a6d4c946]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878530.2304018, 37dab412-5a15-46e8-844e-2ef0c03b7181 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:29:05 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] VM Stopped (Lifecycle Event)
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e3610e-44f3-48fc-a9d5-df1d64c7a226]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:05 user nova-compute[72426]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc (non-flash)
Aug 01 08:29:05 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:05 user nova-compute[72426]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc (non-flash)
Aug 01 08:29:05 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38fe3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG nova.compute.manager [None req-a7b832e4-6b41-416c-8423-fad3ef132320 None None] [instance: 37dab412-5a15-46e8-844e-2ef0c03b7181] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[448f1993-b59b-47d3-989b-5eaba83d89d8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0619c6-a72b-40eb-888c-32fb28d5e704]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[031cc564-b193-4461-9bd9-4e4652376c1d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cfa950-28c9-4a97-b969-3317eb3b928c]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f993af-da27-452a-8e8c-d43240210080]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcb01d1-81b1-43ec-9661-bc7e59c08c2c]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc, portal: 172.16.0.220,3260]
Aug 01 08:29:05 user nova-compute[72426]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc, portal: 172.16.0.220,3260] successful.
Aug 01 08:29:05 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b68b3625-4a89-4bf4-b2f0-0ce4317400bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f20c9ee-dd27-44f5-8f4a-91283e0ddde5]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] <== disconnect_volume: return (276ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:29:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:29:06 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lazy-loading 'flavor' on Instance uuid 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:29:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f79c4c1e-e0a8-475f-86bd-7c28346984a8 tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.600s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUOfeDHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:29:08 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:29:08 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:29:08 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b09123b-9b91-4bf1-bd90-50e6d5daa160]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:29:08 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[513eeddd-0f9d-4211-8c80-6813366ab4a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f] added
Aug 01 08:29:08 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efcdb59-6bdd-4e37-97fa-a73ac39b8a50]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[852c81ad-fc2c-4b59-8432-1cd13573aa92]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CUOfeDHT {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CUOfeDHT" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7482b32f-baae-49fa-abe9-a7cf61d1cb0f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CUOfeDHT'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dadf49-b0a3-4949-894d-e9de505574ab]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3009df95-c6d2-4681-a1d4-f2434db22ef2]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:08 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:08 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[27db0079-c9cc-4882-b88a-d6713973d2f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f, portal: 172.16.0.220,3260]
Aug 01 08:29:08 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f, portal: 172.16.0.220,3260] successful.
Aug 01 08:29:08 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4311698a-c1c9-4e2d-bcda-05578f3104e7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e6b48a-c16e-48d1-89df-d8da55f043c5]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:08 user nova-compute[72426]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:29:08 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:08 user nova-compute[72426]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:29:08 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fe84b6-76f5-4402-925a-e730a067605e]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:08 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:29:09 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:29:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUOfeDHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:29:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:29:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23530643266613164', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:29:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530643266613164', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:29:09 user nova-compute[72426]: DEBUG nova.objects.instance [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'flavor' on Instance uuid 1307ee99-42c0-4086-b8b1-120630450f5c {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:29:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:29:09 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:29:09 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:29:09 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:29:09 user nova-compute[72426]:   <serial>1b0fb24a-a14d-468c-8719-78e48012688f</serial>
Aug 01 08:29:09 user nova-compute[72426]: </disk>
Aug 01 08:29:09 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:29:10 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:29:10 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:29:10 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No VIF found with MAC fa:16:3e:f9:22:47, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:29:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b2702cd7-cfe9-4150-9c5d-e60a8f5654d2 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.278s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:12 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878537.3572254, c707f931-d77d-44c8-a352-49e673ff6c0b => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:29:12 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] VM Stopped (Lifecycle Event)
Aug 01 08:29:12 user nova-compute[72426]: DEBUG nova.compute.manager [None req-4eb3c032-ad31-4453-bb87-85f5e9c9cb3f None None] [instance: c707f931-d77d-44c8-a352-49e673ff6c0b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:29:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "3339d839-b77b-4d9c-9694-941ffe2f043b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:29:14 user nova-compute[72426]: INFO nova.compute.claims [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Claim successful on node user
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:29:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.policy [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53c85b986ed140c491cd0ed264e561c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d23fc511343c698af4392fc3de94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:29:14 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Creating image(s)
Aug 01 08:29:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "/opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "/opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "/opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk 1073741824" returned: 0 in 0.057s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Successfully created port: 474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Cannot resize image /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'migration_context' on Instance uuid 3339d839-b77b-4d9c-9694-941ffe2f043b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Ensure instance console log exists: /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:15 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:16 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Successfully updated port: 474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:29:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "refresh_cache-3339d839-b77b-4d9c-9694-941ffe2f043b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:29:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquired lock "refresh_cache-3339d839-b77b-4d9c-9694-941ffe2f043b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:29:16 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:29:16 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:29:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-26d5aaa0-acd1-429a-a4ec-367fb43bfff7 req-363c9d47-6485-4901-bec3-0423755966c1 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received event network-changed-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:29:16 user nova-compute[72426]: DEBUG nova.compute.manager [req-26d5aaa0-acd1-429a-a4ec-367fb43bfff7 req-363c9d47-6485-4901-bec3-0423755966c1 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Refreshing instance network info cache due to event network-changed-474f61c7-b918-4d07-9c81-c3705a271aa8. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:29:16 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-26d5aaa0-acd1-429a-a4ec-367fb43bfff7 req-363c9d47-6485-4901-bec3-0423755966c1 service nova] Acquiring lock "refresh_cache-3339d839-b77b-4d9c-9694-941ffe2f043b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:29:16 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Updating instance_info_cache with network_info: [{"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Releasing lock "refresh_cache-3339d839-b77b-4d9c-9694-941ffe2f043b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Instance network_info: |[{"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-26d5aaa0-acd1-429a-a4ec-367fb43bfff7 req-363c9d47-6485-4901-bec3-0423755966c1 service nova] Acquired lock "refresh_cache-3339d839-b77b-4d9c-9694-941ffe2f043b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.network.neutron [req-26d5aaa0-acd1-429a-a4ec-367fb43bfff7 req-363c9d47-6485-4901-bec3-0423755966c1 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Refreshing network info cache for port 474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Start _get_guest_xml network_info=[{"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:29:17 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:29:17 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1576178608',display_name='tempest-AttachVolumeNegativeTest-server-1576178608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1576178608',id=43,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNKLwrrhafWDAmJd99FXs8QUTuhgr7K6bZVcEJWhLzKzRT4rSNXRjA3+61wprtvIWWIb25ut+n9gEmpDo31N1b+FfMD9fNpSjijI5rSOEQriWKp1sE89JcIGY9mpw2njQ==',key_name='tempest-keypair-1121834479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-dovteoi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:29:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=3339d839-b77b-4d9c-9694-941ffe2f043b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=474f61c7-b918-4d07-9c81-c3705a271aa8,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap474f61c7-b9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'pci_devices' on Instance uuid 3339d839-b77b-4d9c-9694-941ffe2f043b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:29:17 user nova-compute[72426]:   <uuid>3339d839-b77b-4d9c-9694-941ffe2f043b</uuid>
Aug 01 08:29:17 user nova-compute[72426]:   <name>instance-0000002b</name>
Aug 01 08:29:17 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:29:17 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:29:17 user nova-compute[72426]:   <metadata>
Aug 01 08:29:17 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:29:17 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:29:17 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1576178608</nova:name>
Aug 01 08:29:17 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:29:17</nova:creationTime>
Aug 01 08:29:17 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:29:17 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:29:17 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:29:17 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:29:17 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:29:17 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:29:17 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:29:17 user nova-compute[72426]:       <nova:owner>
Aug 01 08:29:17 user nova-compute[72426]:         <nova:user uuid="53c85b986ed140c491cd0ed264e561c7">tempest-AttachVolumeNegativeTest-1212503363-project-member</nova:user>
Aug 01 08:29:17 user nova-compute[72426]:         <nova:project uuid="0d0d23fc511343c698af4392fc3de94b">tempest-AttachVolumeNegativeTest-1212503363</nova:project>
Aug 01 08:29:17 user nova-compute[72426]:       </nova:owner>
Aug 01 08:29:17 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:29:17 user nova-compute[72426]:       <nova:ports>
Aug 01 08:29:17 user nova-compute[72426]:         <nova:port uuid="474f61c7-b918-4d07-9c81-c3705a271aa8">
Aug 01 08:29:17 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 08:29:17 user nova-compute[72426]:         </nova:port>
Aug 01 08:29:17 user nova-compute[72426]:       </nova:ports>
Aug 01 08:29:17 user nova-compute[72426]:     </nova:instance>
Aug 01 08:29:17 user nova-compute[72426]:   </metadata>
Aug 01 08:29:17 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:29:17 user nova-compute[72426]:     <system>
Aug 01 08:29:17 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:29:17 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:29:17 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:29:17 user nova-compute[72426]:       <entry name="serial">3339d839-b77b-4d9c-9694-941ffe2f043b</entry>
Aug 01 08:29:17 user nova-compute[72426]:       <entry name="uuid">3339d839-b77b-4d9c-9694-941ffe2f043b</entry>
Aug 01 08:29:17 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:29:17 user nova-compute[72426]:     </system>
Aug 01 08:29:17 user nova-compute[72426]:   </sysinfo>
Aug 01 08:29:17 user nova-compute[72426]:   <os>
Aug 01 08:29:17 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:29:17 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:29:17 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:29:17 user nova-compute[72426]:   </os>
Aug 01 08:29:17 user nova-compute[72426]:   <features>
Aug 01 08:29:17 user nova-compute[72426]:     <acpi/>
Aug 01 08:29:17 user nova-compute[72426]:     <apic/>
Aug 01 08:29:17 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:29:17 user nova-compute[72426]:   </features>
Aug 01 08:29:17 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:29:17 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:29:17 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:29:17 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:29:17 user nova-compute[72426]:   </clock>
Aug 01 08:29:17 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:29:17 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:29:17 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:29:17 user nova-compute[72426]:   </cpu>
Aug 01 08:29:17 user nova-compute[72426]:   <devices>
Aug 01 08:29:17 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:29:17 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:29:17 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk"/>
Aug 01 08:29:17 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:29:17 user nova-compute[72426]:     </disk>
Aug 01 08:29:17 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:29:17 user nova-compute[72426]:       <mac address="fa:16:3e:b0:eb:be"/>
Aug 01 08:29:17 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:29:17 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:29:17 user nova-compute[72426]:       <target dev="tap474f61c7-b9"/>
Aug 01 08:29:17 user nova-compute[72426]:     </interface>
Aug 01 08:29:17 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:29:17 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/console.log" append="off"/>
Aug 01 08:29:17 user nova-compute[72426]:     </serial>
Aug 01 08:29:17 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:29:17 user nova-compute[72426]:     <video>
Aug 01 08:29:17 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:29:17 user nova-compute[72426]:     </video>
Aug 01 08:29:17 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:29:17 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:29:17 user nova-compute[72426]:     </rng>
Aug 01 08:29:17 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:29:17 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:29:17 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:29:17 user nova-compute[72426]:     </memballoon>
Aug 01 08:29:17 user nova-compute[72426]:   </devices>
Aug 01 08:29:17 user nova-compute[72426]: </domain>
Aug 01 08:29:17 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1576178608',display_name='tempest-AttachVolumeNegativeTest-server-1576178608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1576178608',id=43,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNKLwrrhafWDAmJd99FXs8QUTuhgr7K6bZVcEJWhLzKzRT4rSNXRjA3+61wprtvIWWIb25ut+n9gEmpDo31N1b+FfMD9fNpSjijI5rSOEQriWKp1sE89JcIGY9mpw2njQ==',key_name='tempest-keypair-1121834479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-dovteoi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:29:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=3339d839-b77b-4d9c-9694-941ffe2f043b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=474f61c7-b918-4d07-9c81-c3705a271aa8,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap474f61c7-b9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG os_vif [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=474f61c7-b918-4d07-9c81-c3705a271aa8,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap474f61c7-b9') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap474f61c7-b9, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap474f61c7-b9, col_values=(('external_ids', {'iface-id': '474f61c7-b918-4d07-9c81-c3705a271aa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:eb:be', 'vm-uuid': '3339d839-b77b-4d9c-9694-941ffe2f043b'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:17 user nova-compute[72426]: INFO os_vif [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=474f61c7-b918-4d07-9c81-c3705a271aa8,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap474f61c7-b9')
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No VIF found with MAC fa:16:3e:b0:eb:be, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.network.neutron [req-26d5aaa0-acd1-429a-a4ec-367fb43bfff7 req-363c9d47-6485-4901-bec3-0423755966c1 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Updated VIF entry in instance network info cache for port 474f61c7-b918-4d07-9c81-c3705a271aa8. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG nova.network.neutron [req-26d5aaa0-acd1-429a-a4ec-367fb43bfff7 req-363c9d47-6485-4901-bec3-0423755966c1 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Updating instance_info_cache with network_info: [{"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:29:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-26d5aaa0-acd1-429a-a4ec-367fb43bfff7 req-363c9d47-6485-4901-bec3-0423755966c1 service nova] Releasing lock "refresh_cache-3339d839-b77b-4d9c-9694-941ffe2f043b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:29:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-37d503ff-5db9-4510-bb8d-2ab5f6433727 req-7e2d322f-8697-4014-8478-de5f75dc56a4 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received event network-vif-plugged-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:29:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-37d503ff-5db9-4510-bb8d-2ab5f6433727 req-7e2d322f-8697-4014-8478-de5f75dc56a4 service nova] Acquiring lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-37d503ff-5db9-4510-bb8d-2ab5f6433727 req-7e2d322f-8697-4014-8478-de5f75dc56a4 service nova] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:18 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-37d503ff-5db9-4510-bb8d-2ab5f6433727 req-7e2d322f-8697-4014-8478-de5f75dc56a4 service nova] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:18 user nova-compute[72426]: DEBUG nova.compute.manager [req-37d503ff-5db9-4510-bb8d-2ab5f6433727 req-7e2d322f-8697-4014-8478-de5f75dc56a4 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] No waiting events found dispatching network-vif-plugged-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:29:18 user nova-compute[72426]: WARNING nova.compute.manager [req-37d503ff-5db9-4510-bb8d-2ab5f6433727 req-7e2d322f-8697-4014-8478-de5f75dc56a4 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received unexpected event network-vif-plugged-474f61c7-b918-4d07-9c81-c3705a271aa8 for instance with vm_state building and task_state spawning.
Aug 01 08:29:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878560.7925742, 3339d839-b77b-4d9c-9694-941ffe2f043b => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:29:20 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] VM Resumed (Lifecycle Event)
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:29:20 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Instance spawned successfully.
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:29:20 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878560.797269, 3339d839-b77b-4d9c-9694-941ffe2f043b => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:29:20 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] VM Started (Lifecycle Event)
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:29:20 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:29:20 user nova-compute[72426]: INFO nova.compute.manager [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Took 6.04 seconds to spawn the instance on the hypervisor.
Aug 01 08:29:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:29:21 user nova-compute[72426]: INFO nova.compute.manager [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Took 6.85 seconds to build instance.
Aug 01 08:29:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-51af41ad-5612-4371-b332-54a15abc2bfe req-1258baf7-57d1-49e5-8aa1-86826a210bd1 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received event network-vif-plugged-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:29:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-51af41ad-5612-4371-b332-54a15abc2bfe req-1258baf7-57d1-49e5-8aa1-86826a210bd1 service nova] Acquiring lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-51af41ad-5612-4371-b332-54a15abc2bfe req-1258baf7-57d1-49e5-8aa1-86826a210bd1 service nova] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-51af41ad-5612-4371-b332-54a15abc2bfe req-1258baf7-57d1-49e5-8aa1-86826a210bd1 service nova] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-51af41ad-5612-4371-b332-54a15abc2bfe req-1258baf7-57d1-49e5-8aa1-86826a210bd1 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] No waiting events found dispatching network-vif-plugged-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:29:21 user nova-compute[72426]: WARNING nova.compute.manager [req-51af41ad-5612-4371-b332-54a15abc2bfe req-1258baf7-57d1-49e5-8aa1-86826a210bd1 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received unexpected event network-vif-plugged-474f61c7-b918-4d07-9c81-c3705a271aa8 for instance with vm_state building and task_state spawning.
Aug 01 08:29:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ce5ca5d8-3f3f-41bc-97e6-0d8d49460e71 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:33 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 08:29:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] There are 0 instances to clean {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 08:29:34 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:34 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:29:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:37 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:29:37 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:29:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7532MB free_disk=25.282222747802734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 8fff7c8e-8129-40f3-ac3b-9b60408705ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 1307ee99-42c0-4086-b8b1-120630450f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 468edb40-0972-4589-9395-826c1eeb0dc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0ca54a63-b572-4d42-986d-7fc2db52e958 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 3339d839-b77b-4d9c-9694-941ffe2f043b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:29:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:29:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:29:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:29:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:29:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:29:40 user nova-compute[72426]: DEBUG nova.objects.instance [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lazy-loading 'info_cache' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:29:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:41 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updating instance_info_cache with network_info: [{"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:29:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-a48d957c-264f-4d4f-a3b7-54e287f606dd" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:29:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:29:41 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:41 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:41 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72426) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 08:29:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:43 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:44 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:29:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:29:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "468edb40-0972-4589-9395-826c1eeb0dc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:53 user nova-compute[72426]: INFO nova.compute.manager [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Terminating instance
Aug 01 08:29:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-b10fc808-a178-462f-be45-9f6c2965d34d req-5c863ead-7164-42dc-ac3b-2163755071ee service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-vif-unplugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b10fc808-a178-462f-be45-9f6c2965d34d req-5c863ead-7164-42dc-ac3b-2163755071ee service nova] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b10fc808-a178-462f-be45-9f6c2965d34d req-5c863ead-7164-42dc-ac3b-2163755071ee service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b10fc808-a178-462f-be45-9f6c2965d34d req-5c863ead-7164-42dc-ac3b-2163755071ee service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-b10fc808-a178-462f-be45-9f6c2965d34d req-5c863ead-7164-42dc-ac3b-2163755071ee service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] No waiting events found dispatching network-vif-unplugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:29:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-b10fc808-a178-462f-be45-9f6c2965d34d req-5c863ead-7164-42dc-ac3b-2163755071ee service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-vif-unplugged-f2a59028-82a7-4744-82f8-b9b0ec197596 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:29:54 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Instance destroyed successfully.
Aug 01 08:29:54 user nova-compute[72426]: DEBUG nova.objects.instance [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lazy-loading 'resources' on Instance uuid 468edb40-0972-4589-9395-826c1eeb0dc6 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:29:54 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-346930247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-346930247',id=36,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOGJcD/bVQDB9UNIgYrZutvKusV64+EQs5MwRC0T3lUQ7Jba0bJ64Nnjdplr37shpC+G0dU9qi9dzjyF5eRM5Lpu8dfSmVg0g6OpDbBLWTgKqBw3s/M6sdjqtKs5hOYow==',key_name='tempest-keypair-1856498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a4cff1bbd5247afa9ed2ddf4db11738',ramdisk_id='',reservation_id='r-08m57t5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1854691353',owner_user_name='tempest-AttachVolumeShelveTestJSON-1854691353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32fed5c40f24c2086d59cbb61f93bea',uuid=468edb40-0972-4589-9395-826c1eeb0dc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:29:54 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converting VIF {"id": "f2a59028-82a7-4744-82f8-b9b0ec197596", "address": "fa:16:3e:52:24:c0", "network": {"id": "1c60c8df-d07d-4982-8fc3-0c5274b39444", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-254215639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a4cff1bbd5247afa9ed2ddf4db11738", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a59028-82", "ovs_interfaceid": "f2a59028-82a7-4744-82f8-b9b0ec197596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:29:54 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:29:54 user nova-compute[72426]: DEBUG os_vif [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:29:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2a59028-82, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:29:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:29:54 user nova-compute[72426]: INFO os_vif [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:24:c0,bridge_name='br-int',has_traffic_filtering=True,id=f2a59028-82a7-4744-82f8-b9b0ec197596,network=Network(1c60c8df-d07d-4982-8fc3-0c5274b39444),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a59028-82')
Aug 01 08:29:54 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Deleting instance files /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6_del
Aug 01 08:29:54 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Deletion of /opt/stack/data/nova/instances/468edb40-0972-4589-9395-826c1eeb0dc6_del complete
Aug 01 08:29:54 user nova-compute[72426]: INFO nova.compute.manager [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 01 08:29:54 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:29:54 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:29:54 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:55 user nova-compute[72426]: INFO nova.compute.manager [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Detaching volume a86f19d1-7bcb-4e96-a84d-f129f7a3843e
Aug 01 08:29:55 user nova-compute[72426]: INFO nova.virt.block_device [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Attempting to driver detach volume a86f19d1-7bcb-4e96-a84d-f129f7a3843e from mountpoint /dev/vdb
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Attempting to detach device vdb from instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:29:55 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:29:55 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:29:55 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:29:55 user nova-compute[72426]:   <serial>a86f19d1-7bcb-4e96-a84d-f129f7a3843e</serial>
Aug 01 08:29:55 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:29:55 user nova-compute[72426]: </disk>
Aug 01 08:29:55 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:55 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Successfully detached device vdb from instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 from the persistent domain config.
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:29:55 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:29:55 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:29:55 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:29:55 user nova-compute[72426]:   <serial>a86f19d1-7bcb-4e96-a84d-f129f7a3843e</serial>
Aug 01 08:29:55 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:29:55 user nova-compute[72426]: </disk>
Aug 01 08:29:55 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-4124f511-80a9-4b82-8ca5-b1d3a1d5b10f req-a6819ce6-a608-41f9-961a-b18a62318acd service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-vif-deleted-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:29:55 user nova-compute[72426]: INFO nova.compute.manager [req-4124f511-80a9-4b82-8ca5-b1d3a1d5b10f req-a6819ce6-a608-41f9-961a-b18a62318acd service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Neutron deleted interface f2a59028-82a7-4744-82f8-b9b0ec197596; detaching it from the instance and deleting it from the info cache
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.network.neutron [req-4124f511-80a9-4b82-8ca5-b1d3a1d5b10f req-a6819ce6-a608-41f9-961a-b18a62318acd service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:29:55 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Took 1.10 seconds to deallocate network for instance.
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-4124f511-80a9-4b82-8ca5-b1d3a1d5b10f req-a6819ce6-a608-41f9-961a-b18a62318acd service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Detach interface failed, port_id=f2a59028-82a7-4744-82f8-b9b0ec197596, reason: Instance 468edb40-0972-4589-9395-826c1eeb0dc6 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878595.8493676, 46dc65bb-be41-48c9-9ffe-513d60afa9c0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:29:55 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Successfully detached device vdb from instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 from the live domain config.
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfzjwcTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:29:55 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:29:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:55 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Deleted allocations for instance 468edb40-0972-4589-9395-826c1eeb0dc6
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7e6ad7-f9c0-41ca-84d4-8ea1f379f203]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3fbfbd-91d4-46d5-bc48-a7c3488ba574]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:55 user nova-compute[72426]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:29:55 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e (non-flash)
Aug 01 08:29:55 user nova-compute[72426]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:29:55 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38a31bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c0e02e-c844-454a-bbb8-d3d21b636294]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69cdf89-5652-4761-8ecd-7af5c49b4f34]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-50bbe6f5-d545-47df-8d09-61ae93a0a495 tempest-AttachVolumeShelveTestJSON-1854691353 tempest-AttachVolumeShelveTestJSON-1854691353-project-member] Lock "468edb40-0972-4589-9395-826c1eeb0dc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.594s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-16915808-d22c-4523-b570-48aa0e53c69a req-2a36f7a4-ca22-407e-9337-da15852dc41e service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-16915808-d22c-4523-b570-48aa0e53c69a req-2a36f7a4-ca22-407e-9337-da15852dc41e service nova] Acquiring lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-16915808-d22c-4523-b570-48aa0e53c69a req-2a36f7a4-ca22-407e-9337-da15852dc41e service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-16915808-d22c-4523-b570-48aa0e53c69a req-2a36f7a4-ca22-407e-9337-da15852dc41e service nova] Lock "468edb40-0972-4589-9395-826c1eeb0dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG nova.compute.manager [req-16915808-d22c-4523-b570-48aa0e53c69a req-2a36f7a4-ca22-407e-9337-da15852dc41e service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] No waiting events found dispatching network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:29:55 user nova-compute[72426]: WARNING nova.compute.manager [req-16915808-d22c-4523-b570-48aa0e53c69a req-2a36f7a4-ca22-407e-9337-da15852dc41e service nova] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Received unexpected event network-vif-plugged-f2a59028-82a7-4744-82f8-b9b0ec197596 for instance with vm_state deleted and task_state None.
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[621989c8-c39e-4e13-bb53-312d4dd320f3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:29:55 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ee73d4-96a5-4911-8e3f-ae9fa753e331]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f286ec3b-fdfc-4ea6-bbc3-b9d36ae1ac61]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36ce6ee-4bae-4912-96de-bc26b861b79b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e, portal: 172.16.0.220,3260]
Aug 01 08:29:56 user nova-compute[72426]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e, portal: 172.16.0.220,3260] successful.
Aug 01 08:29:56 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86f19d1-7bcb-4e96-a84d-f129f7a3843e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[066ed78c-cbdb-464c-b90a-db1990b21c40]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] <== disconnect_volume: return (273ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:29:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:29:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:29:58 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lazy-loading 'flavor' on Instance uuid 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:29:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cd6c8db8-f9e5-4499-a5d6-d5230ad450ad tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:29:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:01 user nova-compute[72426]: INFO nova.compute.manager [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Terminating instance
Aug 01 08:30:01 user nova-compute[72426]: DEBUG nova.compute.manager [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-1a89a7c8-e813-400c-b861-ff2afa46a38c req-aad8effe-f1e2-4a96-9c38-b002b0924f07 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-vif-unplugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1a89a7c8-e813-400c-b861-ff2afa46a38c req-aad8effe-f1e2-4a96-9c38-b002b0924f07 service nova] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1a89a7c8-e813-400c-b861-ff2afa46a38c req-aad8effe-f1e2-4a96-9c38-b002b0924f07 service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1a89a7c8-e813-400c-b861-ff2afa46a38c req-aad8effe-f1e2-4a96-9c38-b002b0924f07 service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-1a89a7c8-e813-400c-b861-ff2afa46a38c req-aad8effe-f1e2-4a96-9c38-b002b0924f07 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] No waiting events found dispatching network-vif-unplugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG nova.compute.manager [req-1a89a7c8-e813-400c-b861-ff2afa46a38c req-aad8effe-f1e2-4a96-9c38-b002b0924f07 service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-vif-unplugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:30:01 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Instance destroyed successfully.
Aug 01 08:30:01 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'resources' on Instance uuid bbb82852-01b7-4609-95a3-f8f36cebbf7d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1308070890',display_name='tempest-ServerRescueNegativeTestJSON-server-1308070890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1308070890',id=19,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:15:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-zdo8fa50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:15:41Z,user_data=None,user_id='e024ff90ae7148819d1d518d3754733f',uuid=bbb82852-01b7-4609-95a3-f8f36cebbf7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "address": "fa:16:3e:64:b6:08", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde38d532-38", "ovs_interfaceid": "de38d532-38d7-42b6-92cd-1c65a2d551b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:b6:08,bridge_name='br-int',has_traffic_filtering=True,id=de38d532-38d7-42b6-92cd-1c65a2d551b1,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde38d532-38') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG os_vif [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:b6:08,bridge_name='br-int',has_traffic_filtering=True,id=de38d532-38d7-42b6-92cd-1c65a2d551b1,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde38d532-38') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde38d532-38, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:01 user nova-compute[72426]: INFO os_vif [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:b6:08,bridge_name='br-int',has_traffic_filtering=True,id=de38d532-38d7-42b6-92cd-1c65a2d551b1,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde38d532-38')
Aug 01 08:30:01 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Deleting instance files /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d_del
Aug 01 08:30:01 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Deletion of /opt/stack/data/nova/instances/bbb82852-01b7-4609-95a3-f8f36cebbf7d_del complete
Aug 01 08:30:02 user nova-compute[72426]: INFO nova.compute.manager [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 08:30:02 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:30:02 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:30:02 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:30:02 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:30:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-07f075f3-46d2-4e23-a50d-d8d5585ff63e req-f78f6aef-9a4d-46ee-b1ab-b672d8ecd4de service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-vif-deleted-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:02 user nova-compute[72426]: INFO nova.compute.manager [req-07f075f3-46d2-4e23-a50d-d8d5585ff63e req-f78f6aef-9a4d-46ee-b1ab-b672d8ecd4de service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Neutron deleted interface de38d532-38d7-42b6-92cd-1c65a2d551b1; detaching it from the instance and deleting it from the info cache
Aug 01 08:30:02 user nova-compute[72426]: DEBUG nova.network.neutron [req-07f075f3-46d2-4e23-a50d-d8d5585ff63e req-f78f6aef-9a4d-46ee-b1ab-b672d8ecd4de service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:30:02 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Took 0.76 seconds to deallocate network for instance.
Aug 01 08:30:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-07f075f3-46d2-4e23-a50d-d8d5585ff63e req-f78f6aef-9a4d-46ee-b1ab-b672d8ecd4de service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Detach interface failed, port_id=de38d532-38d7-42b6-92cd-1c65a2d551b1, reason: Instance bbb82852-01b7-4609-95a3-f8f36cebbf7d could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:30:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:03 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:30:03 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:30:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:03 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Deleted allocations for instance bbb82852-01b7-4609-95a3-f8f36cebbf7d
Aug 01 08:30:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f00f555f-1523-4396-9ec9-d400ae20d227 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.082s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-a9db114a-cb83-400b-8afa-c1761e70b44f req-ee8d7e51-d00e-4501-ae2a-3b704ae4378a service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a9db114a-cb83-400b-8afa-c1761e70b44f req-ee8d7e51-d00e-4501-ae2a-3b704ae4378a service nova] Acquiring lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a9db114a-cb83-400b-8afa-c1761e70b44f req-ee8d7e51-d00e-4501-ae2a-3b704ae4378a service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a9db114a-cb83-400b-8afa-c1761e70b44f req-ee8d7e51-d00e-4501-ae2a-3b704ae4378a service nova] Lock "bbb82852-01b7-4609-95a3-f8f36cebbf7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-a9db114a-cb83-400b-8afa-c1761e70b44f req-ee8d7e51-d00e-4501-ae2a-3b704ae4378a service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] No waiting events found dispatching network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:30:03 user nova-compute[72426]: WARNING nova.compute.manager [req-a9db114a-cb83-400b-8afa-c1761e70b44f req-ee8d7e51-d00e-4501-ae2a-3b704ae4378a service nova] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Received unexpected event network-vif-plugged-de38d532-38d7-42b6-92cd-1c65a2d551b1 for instance with vm_state deleted and task_state None.
Aug 01 08:30:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:09 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878594.2040374, 468edb40-0972-4589-9395-826c1eeb0dc6 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:30:09 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] VM Stopped (Lifecycle Event)
Aug 01 08:30:09 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2a4f6553-2473-4ca6-9430-2626c98a74c1 None None] [instance: 468edb40-0972-4589-9395-826c1eeb0dc6] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:30:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-61ce633a-96ac-4527-a20e-691e511b0f6a req-49dacd1d-48ef-4fa2-a0f3-00ebd0eff93a service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received event network-changed-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-61ce633a-96ac-4527-a20e-691e511b0f6a req-49dacd1d-48ef-4fa2-a0f3-00ebd0eff93a service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Refreshing instance network info cache due to event network-changed-cdc95aa7-0549-4046-8237-b0b98ec1f3cf. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:30:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-61ce633a-96ac-4527-a20e-691e511b0f6a req-49dacd1d-48ef-4fa2-a0f3-00ebd0eff93a service nova] Acquiring lock "refresh_cache-0ca54a63-b572-4d42-986d-7fc2db52e958" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:30:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-61ce633a-96ac-4527-a20e-691e511b0f6a req-49dacd1d-48ef-4fa2-a0f3-00ebd0eff93a service nova] Acquired lock "refresh_cache-0ca54a63-b572-4d42-986d-7fc2db52e958" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:30:10 user nova-compute[72426]: DEBUG nova.network.neutron [req-61ce633a-96ac-4527-a20e-691e511b0f6a req-49dacd1d-48ef-4fa2-a0f3-00ebd0eff93a service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Refreshing network info cache for port cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:30:11 user nova-compute[72426]: DEBUG nova.network.neutron [req-61ce633a-96ac-4527-a20e-691e511b0f6a req-49dacd1d-48ef-4fa2-a0f3-00ebd0eff93a service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Updated VIF entry in instance network info cache for port cdc95aa7-0549-4046-8237-b0b98ec1f3cf. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:30:11 user nova-compute[72426]: DEBUG nova.network.neutron [req-61ce633a-96ac-4527-a20e-691e511b0f6a req-49dacd1d-48ef-4fa2-a0f3-00ebd0eff93a service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Updating instance_info_cache with network_info: [{"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:30:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-61ce633a-96ac-4527-a20e-691e511b0f6a req-49dacd1d-48ef-4fa2-a0f3-00ebd0eff93a service nova] Releasing lock "refresh_cache-0ca54a63-b572-4d42-986d-7fc2db52e958" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:30:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:30:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG nova.objects.instance [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:14 user nova-compute[72426]: INFO nova.compute.manager [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Attaching volume 28e04307-eb7b-4908-abc0-e4eed377dbac to /dev/vdb
Aug 01 08:30:14 user nova-compute[72426]: DEBUG os_brick.utils [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[41de97c5-6309-4326-8fa1-cdfd77fb68d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bdab75-adfa-4f3f-80fc-951635e0923f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:14 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1219a91b-6ee3-4924-b1e4-dcd72965a850]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b390fd0f-be74-4092-8426-db4490ad85ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:30:15 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:30:15 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c142a779-7b36-4283-8251-187a90d83d64]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG os_brick.utils [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:30:15 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Updating existing volume attachment record: 2ba18422-d377-46d7-aaaa-b3161426e51b {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:30:16 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878601.9156692, bbb82852-01b7-4609-95a3-f8f36cebbf7d => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:30:16 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] VM Stopped (Lifecycle Event)
Aug 01 08:30:16 user nova-compute[72426]: DEBUG nova.compute.manager [None req-e8bdd07a-4a96-4588-8a2f-b066610ec787 None None] [instance: bbb82852-01b7-4609-95a3-f8f36cebbf7d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:30:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwlFhWvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:30:22 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:30:22 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:30:22 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c59de1f-2fae-4ee3-b89d-0261188259e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:30:22 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[05484328-6ad9-4d72-8de8-8dd9685e945f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac] added
Aug 01 08:30:22 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ac4822-cc0a-4afc-881f-8bbc596615d7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[46694083-c2b6-4882-9e5c-edb779398efc]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwlFhWvb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwlFhWvb" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[917a1d1b-521e-45d4-8895-7e26535569be]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UwlFhWvb'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bff63e3-33fb-4ee7-8cef-892e1f32a18a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[28369cc2-9bf7-4d65-b685-279f225fd547]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:22 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:22 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92e39ce-56a8-45cb-8d5a-7f47fcca19d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac, portal: 172.16.0.220,3260]
Aug 01 08:30:22 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac, portal: 172.16.0.220,3260] successful.
Aug 01 08:30:22 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1502c09b-78c5-4dfd-b289-876cde39cb6f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc675be4-b197-4ae2-b5ff-3e8cb502a2f8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:22 user nova-compute[72426]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)
Aug 01 08:30:22 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:22 user nova-compute[72426]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)
Aug 01 08:30:22 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfac9ce-f735-4c91-924b-effd33152333]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:30:22 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwlFhWvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:30:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:30:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26363656661376531', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:30:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363656661376531', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:30:23 user nova-compute[72426]: DEBUG nova.objects.instance [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:30:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:30:23 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:30:23 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:30:23 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:30:23 user nova-compute[72426]:   <serial>28e04307-eb7b-4908-abc0-e4eed377dbac</serial>
Aug 01 08:30:23 user nova-compute[72426]: </disk>
Aug 01 08:30:23 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:30:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:30:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:30:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No VIF found with MAC fa:16:3e:fb:d2:7d, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:30:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-05447b93-73dd-4ee9-bdee-fd07a990e7f3 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.296s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG nova.objects.instance [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:28 user nova-compute[72426]: INFO nova.compute.manager [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Attaching volume 38a432f7-5ff3-4eee-83aa-84b2e4f51177 to /dev/vdc
Aug 01 08:30:28 user nova-compute[72426]: DEBUG os_brick.utils [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[343b911c-2e91-4998-8269-a20ccc852efa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6797f5-408d-4df5-8198-6f1e6a2c5a23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddab763-c8bb-4f89-afd9-9a006a6e79b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddf553d-edd0-437b-90fe-58a97888850a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:30:28 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:30:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[148964f7-035b-4cee-8378-f3f050ce2bcb]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG os_brick.utils [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:30:28 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Updating existing volume attachment record: 010a7ece-a88f-4ce1-a9f3-b13f39c65463 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:30:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:30:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:30:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsRkrcCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:30:36 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:30:36 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:30:36 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[585cf929-b2c2-497e-980f-c9fae6964ad5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:30:36 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5022c1c1-dd53-4f9c-95ea-6e2d960d4169]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177] added
Aug 01 08:30:36 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[88080e8f-c5ff-42b7-b1e4-b5dea3d18082]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[560fe5e8-450f-4c98-9320-2586ae22686c]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsRkrcCS {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsRkrcCS" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a498b28e-2b94-4610-b17e-39280c7ad65e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bsRkrcCS'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e9990d-d1a5-4ce2-aea9-c997f75a98c2]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f24ce1-59b5-4d3b-a8cb-67256540ef14]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:36 user nova-compute[72426]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)
Aug 01 08:30:36 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:36 user nova-compute[72426]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)
Aug 01 08:30:36 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bac35c8-c365-4264-90da-5d68c9832270]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177, portal: 172.16.0.220,3260]
Aug 01 08:30:36 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177, portal: 172.16.0.220,3260] successful.
Aug 01 08:30:36 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e02071-cfa2-4730-ac0c-6c2a7e4300d7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a72eff-9dae-483e-a6ad-2ddb703edde0]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:36 user nova-compute[72426]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)
Aug 01 08:30:36 user nova-compute[72426]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 (non-flash)
Aug 01 08:30:36 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:36 user nova-compute[72426]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)
Aug 01 08:30:36 user nova-compute[72426]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 (non-flash)
Aug 01 08:30:36 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[db89ef7b-11e2-4c3b-b45e-98384b3f2d99]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsRkrcCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26562636366623830', 'path': '/dev/sdd'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562636366623830', 'path': '/dev/sdd'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG nova.objects.instance [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:30:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:30:37 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:30:37 user nova-compute[72426]:   <source dev="/dev/sdd"/>
Aug 01 08:30:37 user nova-compute[72426]:   <target dev="vdc" bus="virtio"/>
Aug 01 08:30:37 user nova-compute[72426]:   <serial>38a432f7-5ff3-4eee-83aa-84b2e4f51177</serial>
Aug 01 08:30:37 user nova-compute[72426]: </disk>
Aug 01 08:30:37 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:30:38 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:30:38 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=7840MB free_disk=25.32386016845703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] No VIF found with MAC fa:16:3e:fb:d2:7d, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance a48d957c-264f-4d4f-a3b7-54e287f606dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 8fff7c8e-8129-40f3-ac3b-9b60408705ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 1307ee99-42c0-4086-b8b1-120630450f5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 0ca54a63-b572-4d42-986d-7fc2db52e958 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 3339d839-b77b-4d9c-9694-941ffe2f043b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-52ca20ab-fc88-4387-bfd2-9837da48efd4 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.973s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Refreshing inventories for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Updating ProviderTree inventory for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Updating inventory in ProviderTree for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Refreshing aggregate associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, aggregates: None {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Refreshing trait associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, traits: COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:30:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:39 user nova-compute[72426]: INFO nova.compute.manager [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Detaching volume 28e04307-eb7b-4908-abc0-e4eed377dbac
Aug 01 08:30:39 user nova-compute[72426]: INFO nova.virt.block_device [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Attempting to driver detach volume 28e04307-eb7b-4908-abc0-e4eed377dbac from mountpoint /dev/vdb
Aug 01 08:30:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Attempting to detach device vdb from instance 0ca54a63-b572-4d42-986d-7fc2db52e958 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:30:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:30:39 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:30:39 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:30:39 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:30:39 user nova-compute[72426]:   <serial>28e04307-eb7b-4908-abc0-e4eed377dbac</serial>
Aug 01 08:30:39 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:30:39 user nova-compute[72426]: </disk>
Aug 01 08:30:39 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:30:39 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully detached device vdb from instance 0ca54a63-b572-4d42-986d-7fc2db52e958 from the persistent domain config.
Aug 01 08:30:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ca54a63-b572-4d42-986d-7fc2db52e958 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:30:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:30:39 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:30:39 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:30:39 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:30:39 user nova-compute[72426]:   <serial>28e04307-eb7b-4908-abc0-e4eed377dbac</serial>
Aug 01 08:30:39 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:30:39 user nova-compute[72426]: </disk>
Aug 01 08:30:39 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878640.3890936, 0ca54a63-b572-4d42-986d-7fc2db52e958 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:30:40 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully detached device vdb from instance 0ca54a63-b572-4d42-986d-7fc2db52e958 from the live domain config.
Aug 01 08:30:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwlFhWvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:30:40 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec77672a-8b86-4969-a0e7-88b1489b753c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb8326c-dedd-477a-91aa-ce8e2f75cb05]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:40 user nova-compute[72426]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)
Aug 01 08:30:40 user nova-compute[72426]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 (non-flash)
Aug 01 08:30:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:40 user nova-compute[72426]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac (non-flash)
Aug 01 08:30:40 user nova-compute[72426]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 (non-flash)
Aug 01 08:30:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38df7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f00c41-26dc-4ce1-8098-4fa4f3ab0f31]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e6b246-52b4-47b9-a216-be826a96e212]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b711ae-8ae3-423e-b3ab-ca57b8809e9a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f2ebba-dc86-49c1-8a9d-b27a5c751eb9]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a0ee66-fb9e-4b95-823d-dfdc55cb58d0]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f079b9b8-d03e-49fc-bc06-e3ab9d81948d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac, portal: 172.16.0.220,3260]
Aug 01 08:30:40 user nova-compute[72426]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac, portal: 172.16.0.220,3260] successful.
Aug 01 08:30:40 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28e04307-eb7b-4908-abc0-e4eed377dbac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e082b8c1-14e7-4643-bb3d-45736ec44c55]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== disconnect_volume: return (290ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:30:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:30:41 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:30:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f054f399-d60f-4cd7-b2ae-6df078aa57d8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.802s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:41 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:30:41 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:30:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:30:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-8fff7c8e-8129-40f3-ac3b-9b60408705ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:30:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-8fff7c8e-8129-40f3-ac3b-9b60408705ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:30:41 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:30:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:42 user nova-compute[72426]: INFO nova.compute.manager [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Detaching volume 38a432f7-5ff3-4eee-83aa-84b2e4f51177
Aug 01 08:30:42 user nova-compute[72426]: INFO nova.virt.block_device [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Attempting to driver detach volume 38a432f7-5ff3-4eee-83aa-84b2e4f51177 from mountpoint /dev/vdc
Aug 01 08:30:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Attempting to detach device vdc from instance 0ca54a63-b572-4d42-986d-7fc2db52e958 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:30:42 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:30:42 user nova-compute[72426]:   <source dev="/dev/sdd"/>
Aug 01 08:30:42 user nova-compute[72426]:   <target dev="vdc" bus="virtio"/>
Aug 01 08:30:42 user nova-compute[72426]:   <serial>38a432f7-5ff3-4eee-83aa-84b2e4f51177</serial>
Aug 01 08:30:42 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 08:30:42 user nova-compute[72426]: </disk>
Aug 01 08:30:42 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:30:42 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully detached device vdc from instance 0ca54a63-b572-4d42-986d-7fc2db52e958 from the persistent domain config.
Aug 01 08:30:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0ca54a63-b572-4d42-986d-7fc2db52e958 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:30:42 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:30:42 user nova-compute[72426]:   <source dev="/dev/sdd"/>
Aug 01 08:30:42 user nova-compute[72426]:   <target dev="vdc" bus="virtio"/>
Aug 01 08:30:42 user nova-compute[72426]:   <serial>38a432f7-5ff3-4eee-83aa-84b2e4f51177</serial>
Aug 01 08:30:42 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 08:30:42 user nova-compute[72426]: </disk>
Aug 01 08:30:42 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Updating instance_info_cache with network_info: [{"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-8fff7c8e-8129-40f3-ac3b-9b60408705ac" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878642.83835, 0ca54a63-b572-4d42-986d-7fc2db52e958 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:30:42 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully detached device vdc from instance 0ca54a63-b572-4d42-986d-7fc2db52e958 from the live domain config.
Aug 01 08:30:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsRkrcCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:30:42 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:30:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbb8b0b-2b4f-4ff5-a271-bd9160fc6224]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2123cbe-6cdd-4c30-92d7-42b3588eedfb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:42 user nova-compute[72426]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 (non-flash)
Aug 01 08:30:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:30:42 user nova-compute[72426]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 (non-flash)
Aug 01 08:30:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c389fd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177'): ({'sdd'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Removing single pathed devices sdd {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3e9b6a-8de7-439f-aed9-0ba0dcdb59d4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bb016f-9c0e-40d9-b07c-1edd1b4f8f8a]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Flushing IO for device /dev/sdd {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1fd056-2897-4b03-ad84-058d6eda2137]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:30:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca945a26-3139-4a00-a33e-79e463261983]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] SCSI volumes sdd have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f3072-7cd8-4779-9a30-567ca1eeee72]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b34ced-0a27-4f48-b6f5-61c81b01be0e]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177, portal: 172.16.0.220,3260]
Aug 01 08:30:43 user nova-compute[72426]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177, portal: 172.16.0.220,3260] successful.
Aug 01 08:30:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38a432f7-5ff3-4eee-83aa-84b2e4f51177 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b336ed00-bc8f-4ead-b524-ea25c255eb1a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] <== disconnect_volume: return (289ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG nova.objects.instance [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'flavor' on Instance uuid 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:30:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c2ce7b8a-bdc5-410e-9abd-923c2e0cd4f8 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.717s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:44 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:30:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:45 user nova-compute[72426]: INFO nova.compute.manager [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Terminating instance
Aug 01 08:30:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:45 user nova-compute[72426]: INFO nova.compute.manager [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Terminating instance
Aug 01 08:30:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-9272afda-c4b7-4b11-99fd-a1b60bc2fbf3 req-17337559-e329-4638-bcda-4a2460b9a74b service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received event network-vif-unplugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9272afda-c4b7-4b11-99fd-a1b60bc2fbf3 req-17337559-e329-4638-bcda-4a2460b9a74b service nova] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9272afda-c4b7-4b11-99fd-a1b60bc2fbf3 req-17337559-e329-4638-bcda-4a2460b9a74b service nova] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-9272afda-c4b7-4b11-99fd-a1b60bc2fbf3 req-17337559-e329-4638-bcda-4a2460b9a74b service nova] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-9272afda-c4b7-4b11-99fd-a1b60bc2fbf3 req-17337559-e329-4638-bcda-4a2460b9a74b service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] No waiting events found dispatching network-vif-unplugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-9272afda-c4b7-4b11-99fd-a1b60bc2fbf3 req-17337559-e329-4638-bcda-4a2460b9a74b service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received event network-vif-unplugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Instance destroyed successfully.
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lazy-loading 'resources' on Instance uuid 0ca54a63-b572-4d42-986d-7fc2db52e958 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:28:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-204684804',display_name='tempest-AttachVolumeTestJSON-server-204684804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-204684804',id=42,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmYQr8lV6VgvhjbdlQeRLdT8FWRE1pSJ/WKFSLqVOy+plCj5kAykNauHsE/RW2W5tNnOgVElEamZsymDpxWbMYBVmv9txI2M6g7jvOTXeAHO1K96VTV9U4o9EqJ2atMbA==',key_name='tempest-keypair-1214289459',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:28:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4d025ba4c824773bbeedb7981910a9a',ramdisk_id='',reservation_id='r-0jxvu3ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-173754033',owner_user_name='tempest-AttachVolumeTestJSON-173754033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aab05095eb5347ea9f7e4f7bf33a089a',uuid=0ca54a63-b572-4d42-986d-7fc2db52e958,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converting VIF {"id": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "address": "fa:16:3e:fb:d2:7d", "network": {"id": "1ff7af79-a447-4c64-809e-a96f626e8ce6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1845720160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4d025ba4c824773bbeedb7981910a9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdc95aa7-05", "ovs_interfaceid": "cdc95aa7-0549-4046-8237-b0b98ec1f3cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:d2:7d,bridge_name='br-int',has_traffic_filtering=True,id=cdc95aa7-0549-4046-8237-b0b98ec1f3cf,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc95aa7-05') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG os_vif [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:d2:7d,bridge_name='br-int',has_traffic_filtering=True,id=cdc95aa7-0549-4046-8237-b0b98ec1f3cf,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc95aa7-05') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdc95aa7-05, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:46 user nova-compute[72426]: INFO os_vif [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:d2:7d,bridge_name='br-int',has_traffic_filtering=True,id=cdc95aa7-0549-4046-8237-b0b98ec1f3cf,network=Network(1ff7af79-a447-4c64-809e-a96f626e8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdc95aa7-05')
Aug 01 08:30:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Deleting instance files /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958_del
Aug 01 08:30:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Deletion of /opt/stack/data/nova/instances/0ca54a63-b572-4d42-986d-7fc2db52e958_del complete
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-a2f66073-0040-417e-873e-ce622311448d req-a1d6a51a-9bce-4167-ab9d-ff4173e31274 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received event network-vif-unplugged-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a2f66073-0040-417e-873e-ce622311448d req-a1d6a51a-9bce-4167-ab9d-ff4173e31274 service nova] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a2f66073-0040-417e-873e-ce622311448d req-a1d6a51a-9bce-4167-ab9d-ff4173e31274 service nova] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a2f66073-0040-417e-873e-ce622311448d req-a1d6a51a-9bce-4167-ab9d-ff4173e31274 service nova] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-a2f66073-0040-417e-873e-ce622311448d req-a1d6a51a-9bce-4167-ab9d-ff4173e31274 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] No waiting events found dispatching network-vif-unplugged-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.compute.manager [req-a2f66073-0040-417e-873e-ce622311448d req-a1d6a51a-9bce-4167-ab9d-ff4173e31274 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received event network-vif-unplugged-8c6e8110-5538-45f1-84f0-ad575bd36538 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:30:46 user nova-compute[72426]: INFO nova.compute.manager [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 01 08:30:46 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Instance destroyed successfully.
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lazy-loading 'resources' on Instance uuid 46dc65bb-be41-48c9-9ffe-513d60afa9c0 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:26:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-649723227',display_name='tempest-TestServerVolumeAttachmentScenario-server-649723227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-649723227',id=40,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+hvrYFTZrYcj1ZMf/GuxMu3v7EY7XX08KPsJVT6w+xeq+Zu6gfrgZdRK1wW78RsS5SHC92HMw3gBL62qzpYc/E48ZtuCjAiKO3KiAs1C/83DDDhBmpX2R1Rhvs/q94wg==',key_name='tempest-keypair-827698336',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:26:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d68df7fb0822470ea6cf897d2987db57',ramdisk_id='',reservation_id='r-3zjpripi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-914153557',owner_user_name='tempest-TestServerVolumeAttachmentScenario-914153557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2db17ac7e6544b69fdffa7200b18d17',uuid=46dc65bb-be41-48c9-9ffe-513d60afa9c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Converting VIF {"id": "8c6e8110-5538-45f1-84f0-ad575bd36538", "address": "fa:16:3e:d1:bd:41", "network": {"id": "eec61d64-59a5-4200-92b9-1a4c061d532a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-193141730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d68df7fb0822470ea6cf897d2987db57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c6e8110-55", "ovs_interfaceid": "8c6e8110-5538-45f1-84f0-ad575bd36538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:bd:41,bridge_name='br-int',has_traffic_filtering=True,id=8c6e8110-5538-45f1-84f0-ad575bd36538,network=Network(eec61d64-59a5-4200-92b9-1a4c061d532a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6e8110-55') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG os_vif [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:bd:41,bridge_name='br-int',has_traffic_filtering=True,id=8c6e8110-5538-45f1-84f0-ad575bd36538,network=Network(eec61d64-59a5-4200-92b9-1a4c061d532a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6e8110-55') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c6e8110-55, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:46 user nova-compute[72426]: INFO os_vif [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:bd:41,bridge_name='br-int',has_traffic_filtering=True,id=8c6e8110-5538-45f1-84f0-ad575bd36538,network=Network(eec61d64-59a5-4200-92b9-1a4c061d532a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c6e8110-55')
Aug 01 08:30:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Deleting instance files /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0_del
Aug 01 08:30:46 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Deletion of /opt/stack/data/nova/instances/46dc65bb-be41-48c9-9ffe-513d60afa9c0_del complete
Aug 01 08:30:46 user nova-compute[72426]: INFO nova.compute.manager [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 01 08:30:46 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:30:46 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:30:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-52c9fb5c-5a13-4550-bf0f-93cc7af66db7 req-4815cdb3-7588-4bd0-853a-7bfc4cd4795b service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received event network-vif-plugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-52c9fb5c-5a13-4550-bf0f-93cc7af66db7 req-4815cdb3-7588-4bd0-853a-7bfc4cd4795b service nova] Acquiring lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-52c9fb5c-5a13-4550-bf0f-93cc7af66db7 req-4815cdb3-7588-4bd0-853a-7bfc4cd4795b service nova] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-52c9fb5c-5a13-4550-bf0f-93cc7af66db7 req-4815cdb3-7588-4bd0-853a-7bfc4cd4795b service nova] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-52c9fb5c-5a13-4550-bf0f-93cc7af66db7 req-4815cdb3-7588-4bd0-853a-7bfc4cd4795b service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] No waiting events found dispatching network-vif-plugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:30:48 user nova-compute[72426]: WARNING nova.compute.manager [req-52c9fb5c-5a13-4550-bf0f-93cc7af66db7 req-4815cdb3-7588-4bd0-853a-7bfc4cd4795b service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received unexpected event network-vif-plugged-cdc95aa7-0549-4046-8237-b0b98ec1f3cf for instance with vm_state active and task_state deleting.
Aug 01 08:30:48 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-34ca7e9b-e538-4b71-8dbc-787ce2f6d254 req-12b2e0b6-b84d-47a4-bf55-24b25c8ec41c service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received event network-vif-plugged-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-34ca7e9b-e538-4b71-8dbc-787ce2f6d254 req-12b2e0b6-b84d-47a4-bf55-24b25c8ec41c service nova] Acquiring lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-34ca7e9b-e538-4b71-8dbc-787ce2f6d254 req-12b2e0b6-b84d-47a4-bf55-24b25c8ec41c service nova] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-34ca7e9b-e538-4b71-8dbc-787ce2f6d254 req-12b2e0b6-b84d-47a4-bf55-24b25c8ec41c service nova] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-34ca7e9b-e538-4b71-8dbc-787ce2f6d254 req-12b2e0b6-b84d-47a4-bf55-24b25c8ec41c service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] No waiting events found dispatching network-vif-plugged-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:30:48 user nova-compute[72426]: WARNING nova.compute.manager [req-34ca7e9b-e538-4b71-8dbc-787ce2f6d254 req-12b2e0b6-b84d-47a4-bf55-24b25c8ec41c service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received unexpected event network-vif-plugged-8c6e8110-5538-45f1-84f0-ad575bd36538 for instance with vm_state active and task_state deleting.
Aug 01 08:30:48 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Took 2.03 seconds to deallocate network for instance.
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:48 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Took 1.74 seconds to deallocate network for instance.
Aug 01 08:30:48 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Deleted allocations for instance 0ca54a63-b572-4d42-986d-7fc2db52e958
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-62cafd83-669f-41a2-bdea-9bf6c50de1d5 tempest-AttachVolumeTestJSON-173754033 tempest-AttachVolumeTestJSON-173754033-project-member] Lock "0ca54a63-b572-4d42-986d-7fc2db52e958" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.581s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:48 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Deleted allocations for instance 46dc65bb-be41-48c9-9ffe-513d60afa9c0
Aug 01 08:30:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-68719234-1819-48c7-b2c3-b03cfd5fc4ba tempest-TestServerVolumeAttachmentScenario-914153557 tempest-TestServerVolumeAttachmentScenario-914153557-project-member] Lock "46dc65bb-be41-48c9-9ffe-513d60afa9c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.181s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:30:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-f3bdadc8-5bd9-4d58-a58f-6feb23588dd6 req-81293d8f-c60b-490c-a39f-cbcf29137de6 service nova] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Received event network-vif-deleted-cdc95aa7-0549-4046-8237-b0b98ec1f3cf {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-f3bdadc8-5bd9-4d58-a58f-6feb23588dd6 req-81293d8f-c60b-490c-a39f-cbcf29137de6 service nova] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Received event network-vif-deleted-8c6e8110-5538-45f1-84f0-ad575bd36538 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:50 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:30:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:51 user nova-compute[72426]: INFO nova.compute.manager [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Terminating instance
Aug 01 08:30:51 user nova-compute[72426]: DEBUG nova.compute.manager [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-be70eb74-d1d9-47f7-98ca-f45f9d20e730 req-3e9aef4e-6e24-4201-a462-731100bc4b87 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-be70eb74-d1d9-47f7-98ca-f45f9d20e730 req-3e9aef4e-6e24-4201-a462-731100bc4b87 service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-be70eb74-d1d9-47f7-98ca-f45f9d20e730 req-3e9aef4e-6e24-4201-a462-731100bc4b87 service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-be70eb74-d1d9-47f7-98ca-f45f9d20e730 req-3e9aef4e-6e24-4201-a462-731100bc4b87 service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-be70eb74-d1d9-47f7-98ca-f45f9d20e730 req-3e9aef4e-6e24-4201-a462-731100bc4b87 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG nova.compute.manager [req-be70eb74-d1d9-47f7-98ca-f45f9d20e730 req-3e9aef4e-6e24-4201-a462-731100bc4b87 service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-unplugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:30:52 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Instance destroyed successfully.
Aug 01 08:30:52 user nova-compute[72426]: DEBUG nova.objects.instance [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lazy-loading 'resources' on Instance uuid a48d957c-264f-4d4f-a3b7-54e287f606dd {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-606882209',display_name='tempest-ServerRescueNegativeTestJSON-server-606882209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-606882209',id=18,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:18:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba9024541f804b259eeed3f2dd0ce12f',ramdisk_id='',reservation_id='r-u9xaq11k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1267015268',owner_user_name='tempest-ServerRescueNegativeTestJSON-1267015268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:20:27Z,user_data=None,user_id='e024ff90ae7148819d1d518d3754733f',uuid=a48d957c-264f-4d4f-a3b7-54e287f606dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converting VIF {"id": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "address": "fa:16:3e:24:e2:c7", "network": {"id": "4fbdd536-c805-4732-a526-af0ec74ed565", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509789078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba9024541f804b259eeed3f2dd0ce12f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e1a0b-eb", "ovs_interfaceid": "2b6e1a0b-eb3e-4071-80a3-227777cfa5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:e2:c7,bridge_name='br-int',has_traffic_filtering=True,id=2b6e1a0b-eb3e-4071-80a3-227777cfa5d7,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e1a0b-eb') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG os_vif [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:e2:c7,bridge_name='br-int',has_traffic_filtering=True,id=2b6e1a0b-eb3e-4071-80a3-227777cfa5d7,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e1a0b-eb') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b6e1a0b-eb, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:30:52 user nova-compute[72426]: INFO os_vif [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:e2:c7,bridge_name='br-int',has_traffic_filtering=True,id=2b6e1a0b-eb3e-4071-80a3-227777cfa5d7,network=Network(4fbdd536-c805-4732-a526-af0ec74ed565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e1a0b-eb')
Aug 01 08:30:52 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Deleting instance files /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd_del
Aug 01 08:30:52 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Deletion of /opt/stack/data/nova/instances/a48d957c-264f-4d4f-a3b7-54e287f606dd_del complete
Aug 01 08:30:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:52 user nova-compute[72426]: INFO nova.compute.manager [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 08:30:52 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:30:52 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:30:53 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:30:53 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Took 1.11 seconds to deallocate network for instance.
Aug 01 08:30:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-63ea9b77-c72d-42dc-b52e-8b491027ae43 req-abedcf2b-3976-42ba-924b-d84bb9cf9aed service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-deleted-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:54 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Deleted allocations for instance a48d957c-264f-4d4f-a3b7-54e287f606dd
Aug 01 08:30:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22a33a4a-3552-4809-a807-505413064e40 tempest-ServerRescueNegativeTestJSON-1267015268 tempest-ServerRescueNegativeTestJSON-1267015268-project-member] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.526s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-36ee4e44-7e51-498f-83e6-b336b47aa5d0 req-fff0ced4-c92d-4f32-8449-f6150ab73eaf service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-36ee4e44-7e51-498f-83e6-b336b47aa5d0 req-fff0ced4-c92d-4f32-8449-f6150ab73eaf service nova] Acquiring lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-36ee4e44-7e51-498f-83e6-b336b47aa5d0 req-fff0ced4-c92d-4f32-8449-f6150ab73eaf service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-36ee4e44-7e51-498f-83e6-b336b47aa5d0 req-fff0ced4-c92d-4f32-8449-f6150ab73eaf service nova] Lock "a48d957c-264f-4d4f-a3b7-54e287f606dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:30:54 user nova-compute[72426]: DEBUG nova.compute.manager [req-36ee4e44-7e51-498f-83e6-b336b47aa5d0 req-fff0ced4-c92d-4f32-8449-f6150ab73eaf service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] No waiting events found dispatching network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:30:54 user nova-compute[72426]: WARNING nova.compute.manager [req-36ee4e44-7e51-498f-83e6-b336b47aa5d0 req-fff0ced4-c92d-4f32-8449-f6150ab73eaf service nova] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Received unexpected event network-vif-plugged-2b6e1a0b-eb3e-4071-80a3-227777cfa5d7 for instance with vm_state deleted and task_state None.
Aug 01 08:30:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:30:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:30:59 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:30:59 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:31:00 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:00 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:31:00 user nova-compute[72426]: INFO nova.compute.claims [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Claim successful on node user
Aug 01 08:31:00 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:31:00 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:31:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:31:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:31:00 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:31:00 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:31:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:31:00 user nova-compute[72426]: DEBUG nova.policy [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b17572488ab4d3eb1f951149cc002a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93114c346ec34c6a9d5607f81475643a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878645.977001, 0ca54a63-b572-4d42-986d-7fc2db52e958 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:31:01 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] VM Stopped (Lifecycle Event)
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:31:01 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Creating image(s)
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "/opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "/opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "/opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c16aedb6-6c21-42d3-84e4-44d30d541792 None None] [instance: 0ca54a63-b572-4d42-986d-7fc2db52e958] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.177s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk 1073741824" returned: 0 in 0.068s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878646.6440594, 46dc65bb-be41-48c9-9ffe-513d60afa9c0 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:31:01 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] VM Stopped (Lifecycle Event)
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Successfully created port: f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.compute.manager [None req-62ce8cc8-5457-4d13-8749-c2ee8a6ddbe6 None None] [instance: 46dc65bb-be41-48c9-9ffe-513d60afa9c0] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Cannot resize image /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.objects.instance [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'migration_context' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Ensure instance console log exists: /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:01 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Successfully updated port: f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquired lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-b5aa2a15-5580-45c7-80d2-6c33f73f3e20 req-86334468-bd93-4a06-ba67-cb7582ac3bd5 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received event network-changed-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.compute.manager [req-b5aa2a15-5580-45c7-80d2-6c33f73f3e20 req-86334468-bd93-4a06-ba67-cb7582ac3bd5 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Refreshing instance network info cache due to event network-changed-f441a355-3ad1-4c5a-8062-fc376068e465. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b5aa2a15-5580-45c7-80d2-6c33f73f3e20 req-86334468-bd93-4a06-ba67-cb7582ac3bd5 service nova] Acquiring lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating instance_info_cache with network_info: [{"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Releasing lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Instance network_info: |[{"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b5aa2a15-5580-45c7-80d2-6c33f73f3e20 req-86334468-bd93-4a06-ba67-cb7582ac3bd5 service nova] Acquired lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.network.neutron [req-b5aa2a15-5580-45c7-80d2-6c33f73f3e20 req-86334468-bd93-4a06-ba67-cb7582ac3bd5 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Refreshing network info cache for port f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Start _get_guest_xml network_info=[{"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:31:02 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:31:02 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:31:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-515220998',display_name='tempest-SnapshotDataIntegrityTests-server-515220998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-515220998',id=44,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVIt77/GFD+u/Cv2/KGuImcjOC7sl3Zu7zWYs4XoX0CzGc/RS3eAB10A0ql00A5Cfo/VEm2KQRwBU3hYQng+y9FxjgvwDUcIWSFC91grtFMm87+3IOvIELGLbTdDgXaQw==',key_name='tempest-keypair-1823084927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93114c346ec34c6a9d5607f81475643a',ramdisk_id='',reservation_id='r-0sd8fmwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-517942142',owner_user_name='tempest-SnapshotDataIntegrityTests-517942142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:31:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b17572488ab4d3eb1f951149cc002a2',uuid=81bf3e66-4c1d-46df-8756-b438aab31e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Converting VIF {"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:93:15,bridge_name='br-int',has_traffic_filtering=True,id=f441a355-3ad1-4c5a-8062-fc376068e465,network=Network(3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf441a355-3a') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.objects.instance [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'pci_devices' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:31:03 user nova-compute[72426]:   <uuid>81bf3e66-4c1d-46df-8756-b438aab31e1e</uuid>
Aug 01 08:31:03 user nova-compute[72426]:   <name>instance-0000002c</name>
Aug 01 08:31:03 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:31:03 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:31:03 user nova-compute[72426]:   <metadata>
Aug 01 08:31:03 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:31:03 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:31:03 user nova-compute[72426]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-515220998</nova:name>
Aug 01 08:31:03 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:31:02</nova:creationTime>
Aug 01 08:31:03 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:31:03 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:31:03 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:31:03 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:31:03 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:31:03 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:31:03 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:31:03 user nova-compute[72426]:       <nova:owner>
Aug 01 08:31:03 user nova-compute[72426]:         <nova:user uuid="2b17572488ab4d3eb1f951149cc002a2">tempest-SnapshotDataIntegrityTests-517942142-project-member</nova:user>
Aug 01 08:31:03 user nova-compute[72426]:         <nova:project uuid="93114c346ec34c6a9d5607f81475643a">tempest-SnapshotDataIntegrityTests-517942142</nova:project>
Aug 01 08:31:03 user nova-compute[72426]:       </nova:owner>
Aug 01 08:31:03 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:31:03 user nova-compute[72426]:       <nova:ports>
Aug 01 08:31:03 user nova-compute[72426]:         <nova:port uuid="f441a355-3ad1-4c5a-8062-fc376068e465">
Aug 01 08:31:03 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 08:31:03 user nova-compute[72426]:         </nova:port>
Aug 01 08:31:03 user nova-compute[72426]:       </nova:ports>
Aug 01 08:31:03 user nova-compute[72426]:     </nova:instance>
Aug 01 08:31:03 user nova-compute[72426]:   </metadata>
Aug 01 08:31:03 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:31:03 user nova-compute[72426]:     <system>
Aug 01 08:31:03 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:31:03 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:31:03 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:31:03 user nova-compute[72426]:       <entry name="serial">81bf3e66-4c1d-46df-8756-b438aab31e1e</entry>
Aug 01 08:31:03 user nova-compute[72426]:       <entry name="uuid">81bf3e66-4c1d-46df-8756-b438aab31e1e</entry>
Aug 01 08:31:03 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:31:03 user nova-compute[72426]:     </system>
Aug 01 08:31:03 user nova-compute[72426]:   </sysinfo>
Aug 01 08:31:03 user nova-compute[72426]:   <os>
Aug 01 08:31:03 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:31:03 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:31:03 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:31:03 user nova-compute[72426]:   </os>
Aug 01 08:31:03 user nova-compute[72426]:   <features>
Aug 01 08:31:03 user nova-compute[72426]:     <acpi/>
Aug 01 08:31:03 user nova-compute[72426]:     <apic/>
Aug 01 08:31:03 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:31:03 user nova-compute[72426]:   </features>
Aug 01 08:31:03 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:31:03 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:31:03 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:31:03 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:31:03 user nova-compute[72426]:   </clock>
Aug 01 08:31:03 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:31:03 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:31:03 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:31:03 user nova-compute[72426]:   </cpu>
Aug 01 08:31:03 user nova-compute[72426]:   <devices>
Aug 01 08:31:03 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:31:03 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:31:03 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk"/>
Aug 01 08:31:03 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:31:03 user nova-compute[72426]:     </disk>
Aug 01 08:31:03 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:31:03 user nova-compute[72426]:       <mac address="fa:16:3e:d3:93:15"/>
Aug 01 08:31:03 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:31:03 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:31:03 user nova-compute[72426]:       <target dev="tapf441a355-3a"/>
Aug 01 08:31:03 user nova-compute[72426]:     </interface>
Aug 01 08:31:03 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:31:03 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/console.log" append="off"/>
Aug 01 08:31:03 user nova-compute[72426]:     </serial>
Aug 01 08:31:03 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:31:03 user nova-compute[72426]:     <video>
Aug 01 08:31:03 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:31:03 user nova-compute[72426]:     </video>
Aug 01 08:31:03 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:31:03 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:31:03 user nova-compute[72426]:     </rng>
Aug 01 08:31:03 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:31:03 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:31:03 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:31:03 user nova-compute[72426]:     </memballoon>
Aug 01 08:31:03 user nova-compute[72426]:   </devices>
Aug 01 08:31:03 user nova-compute[72426]: </domain>
Aug 01 08:31:03 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-515220998',display_name='tempest-SnapshotDataIntegrityTests-server-515220998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-515220998',id=44,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVIt77/GFD+u/Cv2/KGuImcjOC7sl3Zu7zWYs4XoX0CzGc/RS3eAB10A0ql00A5Cfo/VEm2KQRwBU3hYQng+y9FxjgvwDUcIWSFC91grtFMm87+3IOvIELGLbTdDgXaQw==',key_name='tempest-keypair-1823084927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93114c346ec34c6a9d5607f81475643a',ramdisk_id='',reservation_id='r-0sd8fmwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-517942142',owner_user_name='tempest-SnapshotDataIntegrityTests-517942142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:31:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b17572488ab4d3eb1f951149cc002a2',uuid=81bf3e66-4c1d-46df-8756-b438aab31e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Converting VIF {"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:93:15,bridge_name='br-int',has_traffic_filtering=True,id=f441a355-3ad1-4c5a-8062-fc376068e465,network=Network(3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf441a355-3a') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG os_vif [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:93:15,bridge_name='br-int',has_traffic_filtering=True,id=f441a355-3ad1-4c5a-8062-fc376068e465,network=Network(3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf441a355-3a') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf441a355-3a, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf441a355-3a, col_values=(('external_ids', {'iface-id': 'f441a355-3ad1-4c5a-8062-fc376068e465', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:93:15', 'vm-uuid': '81bf3e66-4c1d-46df-8756-b438aab31e1e'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:03 user nova-compute[72426]: INFO os_vif [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:93:15,bridge_name='br-int',has_traffic_filtering=True,id=f441a355-3ad1-4c5a-8062-fc376068e465,network=Network(3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf441a355-3a')
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No VIF found with MAC fa:16:3e:d3:93:15, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.network.neutron [req-b5aa2a15-5580-45c7-80d2-6c33f73f3e20 req-86334468-bd93-4a06-ba67-cb7582ac3bd5 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updated VIF entry in instance network info cache for port f441a355-3ad1-4c5a-8062-fc376068e465. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG nova.network.neutron [req-b5aa2a15-5580-45c7-80d2-6c33f73f3e20 req-86334468-bd93-4a06-ba67-cb7582ac3bd5 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating instance_info_cache with network_info: [{"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:31:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b5aa2a15-5580-45c7-80d2-6c33f73f3e20 req-86334468-bd93-4a06-ba67-cb7582ac3bd5 service nova] Releasing lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:31:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-d0a7b8d4-c908-4610-b2e9-4e3a9a37a03d req-c0e50cf6-1ed0-4fa0-bd6b-6a16f353a6d7 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received event network-vif-plugged-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:31:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d0a7b8d4-c908-4610-b2e9-4e3a9a37a03d req-c0e50cf6-1ed0-4fa0-bd6b-6a16f353a6d7 service nova] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d0a7b8d4-c908-4610-b2e9-4e3a9a37a03d req-c0e50cf6-1ed0-4fa0-bd6b-6a16f353a6d7 service nova] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-d0a7b8d4-c908-4610-b2e9-4e3a9a37a03d req-c0e50cf6-1ed0-4fa0-bd6b-6a16f353a6d7 service nova] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-d0a7b8d4-c908-4610-b2e9-4e3a9a37a03d req-c0e50cf6-1ed0-4fa0-bd6b-6a16f353a6d7 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] No waiting events found dispatching network-vif-plugged-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:31:04 user nova-compute[72426]: WARNING nova.compute.manager [req-d0a7b8d4-c908-4610-b2e9-4e3a9a37a03d req-c0e50cf6-1ed0-4fa0-bd6b-6a16f353a6d7 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received unexpected event network-vif-plugged-f441a355-3ad1-4c5a-8062-fc376068e465 for instance with vm_state building and task_state spawning.
Aug 01 08:31:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-7f7b4b56-6da1-4015-90c4-8c86388e96ef req-3e29f239-57a0-4e0a-8bbf-e38fd1c31927 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received event network-changed-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:31:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-7f7b4b56-6da1-4015-90c4-8c86388e96ef req-3e29f239-57a0-4e0a-8bbf-e38fd1c31927 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Refreshing instance network info cache due to event network-changed-474f61c7-b918-4d07-9c81-c3705a271aa8. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:31:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7f7b4b56-6da1-4015-90c4-8c86388e96ef req-3e29f239-57a0-4e0a-8bbf-e38fd1c31927 service nova] Acquiring lock "refresh_cache-3339d839-b77b-4d9c-9694-941ffe2f043b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:31:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7f7b4b56-6da1-4015-90c4-8c86388e96ef req-3e29f239-57a0-4e0a-8bbf-e38fd1c31927 service nova] Acquired lock "refresh_cache-3339d839-b77b-4d9c-9694-941ffe2f043b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:31:05 user nova-compute[72426]: DEBUG nova.network.neutron [req-7f7b4b56-6da1-4015-90c4-8c86388e96ef req-3e29f239-57a0-4e0a-8bbf-e38fd1c31927 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Refreshing network info cache for port 474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:31:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:05 user nova-compute[72426]: DEBUG nova.network.neutron [req-7f7b4b56-6da1-4015-90c4-8c86388e96ef req-3e29f239-57a0-4e0a-8bbf-e38fd1c31927 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Updated VIF entry in instance network info cache for port 474f61c7-b918-4d07-9c81-c3705a271aa8. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:31:05 user nova-compute[72426]: DEBUG nova.network.neutron [req-7f7b4b56-6da1-4015-90c4-8c86388e96ef req-3e29f239-57a0-4e0a-8bbf-e38fd1c31927 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Updating instance_info_cache with network_info: [{"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7f7b4b56-6da1-4015-90c4-8c86388e96ef req-3e29f239-57a0-4e0a-8bbf-e38fd1c31927 service nova] Releasing lock "refresh_cache-3339d839-b77b-4d9c-9694-941ffe2f043b" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "3339d839-b77b-4d9c-9694-941ffe2f043b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:06 user nova-compute[72426]: INFO nova.compute.manager [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Terminating instance
Aug 01 08:31:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-c3d70b65-d937-4fbe-97a1-cad8bcadaa70 req-df31d4ae-a5d4-45f0-a1d1-b05377d16658 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received event network-vif-plugged-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c3d70b65-d937-4fbe-97a1-cad8bcadaa70 req-df31d4ae-a5d4-45f0-a1d1-b05377d16658 service nova] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c3d70b65-d937-4fbe-97a1-cad8bcadaa70 req-df31d4ae-a5d4-45f0-a1d1-b05377d16658 service nova] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c3d70b65-d937-4fbe-97a1-cad8bcadaa70 req-df31d4ae-a5d4-45f0-a1d1-b05377d16658 service nova] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-c3d70b65-d937-4fbe-97a1-cad8bcadaa70 req-df31d4ae-a5d4-45f0-a1d1-b05377d16658 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] No waiting events found dispatching network-vif-plugged-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:31:06 user nova-compute[72426]: WARNING nova.compute.manager [req-c3d70b65-d937-4fbe-97a1-cad8bcadaa70 req-df31d4ae-a5d4-45f0-a1d1-b05377d16658 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received unexpected event network-vif-plugged-f441a355-3ad1-4c5a-8062-fc376068e465 for instance with vm_state building and task_state spawning.
Aug 01 08:31:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878667.1055624, 81bf3e66-4c1d-46df-8756-b438aab31e1e => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] VM Resumed (Lifecycle Event)
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Instance spawned successfully.
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878667.1069481, 81bf3e66-4c1d-46df-8756-b438aab31e1e => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] VM Started (Lifecycle Event)
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.compute.manager [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Took 6.18 seconds to spawn the instance on the hypervisor.
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:31:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Instance destroyed successfully.
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.objects.instance [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'resources' on Instance uuid 3339d839-b77b-4d9c-9694-941ffe2f043b {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.compute.manager [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Took 7.30 seconds to build instance.
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1576178608',display_name='tempest-AttachVolumeNegativeTest-server-1576178608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1576178608',id=43,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNKLwrrhafWDAmJd99FXs8QUTuhgr7K6bZVcEJWhLzKzRT4rSNXRjA3+61wprtvIWWIb25ut+n9gEmpDo31N1b+FfMD9fNpSjijI5rSOEQriWKp1sE89JcIGY9mpw2njQ==',key_name='tempest-keypair-1121834479',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:29:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-dovteoi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:29:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=3339d839-b77b-4d9c-9694-941ffe2f043b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "474f61c7-b918-4d07-9c81-c3705a271aa8", "address": "fa:16:3e:b0:eb:be", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap474f61c7-b9", "ovs_interfaceid": "474f61c7-b918-4d07-9c81-c3705a271aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=474f61c7-b918-4d07-9c81-c3705a271aa8,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap474f61c7-b9') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG os_vif [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=474f61c7-b918-4d07-9c81-c3705a271aa8,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap474f61c7-b9') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap474f61c7-b9, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9222fa5c-312e-48af-a591-92e3adb9f78d tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.477s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:31:07 user nova-compute[72426]: INFO os_vif [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=474f61c7-b918-4d07-9c81-c3705a271aa8,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap474f61c7-b9')
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Deleting instance files /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b_del
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Deletion of /opt/stack/data/nova/instances/3339d839-b77b-4d9c-9694-941ffe2f043b_del complete
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-7f40d87f-f1b1-4638-b373-0abe4c0c6a40 req-cc6f1cbf-134f-4a45-8b52-434c94e8ef80 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received event network-vif-unplugged-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7f40d87f-f1b1-4638-b373-0abe4c0c6a40 req-cc6f1cbf-134f-4a45-8b52-434c94e8ef80 service nova] Acquiring lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7f40d87f-f1b1-4638-b373-0abe4c0c6a40 req-cc6f1cbf-134f-4a45-8b52-434c94e8ef80 service nova] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7f40d87f-f1b1-4638-b373-0abe4c0c6a40 req-cc6f1cbf-134f-4a45-8b52-434c94e8ef80 service nova] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-7f40d87f-f1b1-4638-b373-0abe4c0c6a40 req-cc6f1cbf-134f-4a45-8b52-434c94e8ef80 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] No waiting events found dispatching network-vif-unplugged-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [req-7f40d87f-f1b1-4638-b373-0abe4c0c6a40 req-cc6f1cbf-134f-4a45-8b52-434c94e8ef80 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received event network-vif-unplugged-474f61c7-b918-4d07-9c81-c3705a271aa8 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.compute.manager [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 01 08:31:07 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878652.746942, a48d957c-264f-4d4f-a3b7-54e287f606dd => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:31:07 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] VM Stopped (Lifecycle Event)
Aug 01 08:31:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-2a513f09-7f8a-4f70-8151-14ae80253c55 None None] [instance: a48d957c-264f-4d4f-a3b7-54e287f606dd] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:31:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:08 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:31:08 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Took 1.20 seconds to deallocate network for instance.
Aug 01 08:31:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-220d1bc0-5621-4b8b-bb65-65a770f74e46 req-c84a50bb-3369-4db8-973c-fea5e672aa91 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received event network-vif-deleted-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:31:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:09 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:31:09 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:31:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:09 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Deleted allocations for instance 3339d839-b77b-4d9c-9694-941ffe2f043b
Aug 01 08:31:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b865fd4d-4359-4f31-b594-f4fd15b1c1b5 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.595s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-b57d452c-c6fe-499f-92e1-7581de100985 req-92bdb1b2-a778-4f8a-bf1e-adde6fb1fb14 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received event network-vif-plugged-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:31:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b57d452c-c6fe-499f-92e1-7581de100985 req-92bdb1b2-a778-4f8a-bf1e-adde6fb1fb14 service nova] Acquiring lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b57d452c-c6fe-499f-92e1-7581de100985 req-92bdb1b2-a778-4f8a-bf1e-adde6fb1fb14 service nova] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b57d452c-c6fe-499f-92e1-7581de100985 req-92bdb1b2-a778-4f8a-bf1e-adde6fb1fb14 service nova] Lock "3339d839-b77b-4d9c-9694-941ffe2f043b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:09 user nova-compute[72426]: DEBUG nova.compute.manager [req-b57d452c-c6fe-499f-92e1-7581de100985 req-92bdb1b2-a778-4f8a-bf1e-adde6fb1fb14 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] No waiting events found dispatching network-vif-plugged-474f61c7-b918-4d07-9c81-c3705a271aa8 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:31:09 user nova-compute[72426]: WARNING nova.compute.manager [req-b57d452c-c6fe-499f-92e1-7581de100985 req-92bdb1b2-a778-4f8a-bf1e-adde6fb1fb14 service nova] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Received unexpected event network-vif-plugged-474f61c7-b918-4d07-9c81-c3705a271aa8 for instance with vm_state deleted and task_state None.
Aug 01 08:31:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:22 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878667.3542695, 3339d839-b77b-4d9c-9694-941ffe2f043b => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:31:22 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] VM Stopped (Lifecycle Event)
Aug 01 08:31:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-98f1d836-ae23-4afd-96a2-a7c2bdd1702c None None] [instance: 3339d839-b77b-4d9c-9694-941ffe2f043b] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:31:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:31:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:31:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:36 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:31:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:37 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:31:37 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:31:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=25.394065856933594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 8fff7c8e-8129-40f3-ac3b-9b60408705ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 1307ee99-42c0-4086-b8b1-120630450f5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 81bf3e66-4c1d-46df-8756-b438aab31e1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:41 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:31:41 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:31:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:31:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:31:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:31:41 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:31:42 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Updating instance_info_cache with network_info: [{"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:31:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-1307ee99-42c0-4086-b8b1-120630450f5c" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:31:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:31:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:31:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:43 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:31:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:31:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:31:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:31:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:31:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:31:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "1307ee99-42c0-4086-b8b1-120630450f5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:31:58 user nova-compute[72426]: INFO nova.compute.manager [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Detaching volume 1b0fb24a-a14d-468c-8719-78e48012688f
Aug 01 08:31:58 user nova-compute[72426]: INFO nova.virt.block_device [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Attempting to driver detach volume 1b0fb24a-a14d-468c-8719-78e48012688f from mountpoint /dev/vdb
Aug 01 08:31:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Attempting to detach device vdb from instance 1307ee99-42c0-4086-b8b1-120630450f5c from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:31:58 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:31:58 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:31:58 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:31:58 user nova-compute[72426]:   <serial>1b0fb24a-a14d-468c-8719-78e48012688f</serial>
Aug 01 08:31:58 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:31:58 user nova-compute[72426]: </disk>
Aug 01 08:31:58 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:31:58 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully detached device vdb from instance 1307ee99-42c0-4086-b8b1-120630450f5c from the persistent domain config.
Aug 01 08:31:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1307ee99-42c0-4086-b8b1-120630450f5c from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:31:58 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:31:58 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:31:58 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:31:58 user nova-compute[72426]:   <serial>1b0fb24a-a14d-468c-8719-78e48012688f</serial>
Aug 01 08:31:58 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:31:58 user nova-compute[72426]: </disk>
Aug 01 08:31:58 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878718.9171207, 1307ee99-42c0-4086-b8b1-120630450f5c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1307ee99-42c0-4086-b8b1-120630450f5c {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:31:58 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully detached device vdb from instance 1307ee99-42c0-4086-b8b1-120630450f5c from the live domain config.
Aug 01 08:31:58 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUOfeDHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:31:58 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:31:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65951ec-5bed-4840-b7c3-3a467050a8e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[711ff243-e8eb-421d-a65c-a57156fd34ba]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:31:58 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f (non-flash)
Aug 01 08:31:58 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c5c46db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:31:58 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fce60f0-a57f-48d8-bf3a-bccbf58e6f56]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[62266785-88d2-47bb-98c7-28b2b86f29a7]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[25935a54-fce1-4d23-a232-2a0d2bf65d8b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bd9142-4e55-467a-9cf0-3123dbd8083c]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[97029d00-0b5e-4b32-89db-e5eb27368c2d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a70fe9-85bd-42a6-b458-a9493b4d0dcb]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f, portal: 172.16.0.220,3260]
Aug 01 08:31:59 user nova-compute[72426]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f, portal: 172.16.0.220,3260] successful.
Aug 01 08:31:59 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0fb24a-a14d-468c-8719-78e48012688f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcc73c6-3612-42b2-84d9-2e5b2ebe9b4d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] <== disconnect_volume: return (297ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:31:59 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:32:00 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'flavor' on Instance uuid 1307ee99-42c0-4086-b8b1-120630450f5c {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:32:00 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ecc68001-dcc7-4aaf-84c2-6f20795f873b tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.925s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:32:19 user nova-compute[72426]: INFO nova.compute.claims [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Claim successful on node user
Aug 01 08:32:19 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG nova.network.neutron [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:32:19 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:32:19 user nova-compute[72426]: DEBUG nova.compute.manager [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:32:19 user nova-compute[72426]: DEBUG nova.policy [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58361e4852e8467790067d63012c7ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75edfbd8534a9c84575464a28cdb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG nova.compute.manager [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:32:20 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Creating image(s)
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "/opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "/opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk 1073741824" returned: 0 in 0.062s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG nova.network.neutron [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Successfully created port: e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Cannot resize image /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG nova.objects.instance [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'migration_context' on Instance uuid 7cd92c00-7b80-4582-9ab1-da081b64fc41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Ensure instance console log exists: /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Successfully updated port: e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:32:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:32:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquired lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:32:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:32:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-8841f871-d126-469f-9a75-2c29b30a3db6 req-6bb2d7b7-5acc-484f-9f55-77d8a1994af7 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received event network-changed-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:32:21 user nova-compute[72426]: DEBUG nova.compute.manager [req-8841f871-d126-469f-9a75-2c29b30a3db6 req-6bb2d7b7-5acc-484f-9f55-77d8a1994af7 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Refreshing instance network info cache due to event network-changed-e8c465c8-351b-4050-b925-d21de30fbb70. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:32:21 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8841f871-d126-469f-9a75-2c29b30a3db6 req-6bb2d7b7-5acc-484f-9f55-77d8a1994af7 service nova] Acquiring lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:32:21 user nova-compute[72426]: DEBUG nova.network.neutron [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.network.neutron [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Updating instance_info_cache with network_info: [{"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Releasing lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Instance network_info: |[{"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8841f871-d126-469f-9a75-2c29b30a3db6 req-6bb2d7b7-5acc-484f-9f55-77d8a1994af7 service nova] Acquired lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.network.neutron [req-8841f871-d126-469f-9a75-2c29b30a3db6 req-6bb2d7b7-5acc-484f-9f55-77d8a1994af7 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Refreshing network info cache for port e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Start _get_guest_xml network_info=[{"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:32:22 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:32:22 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1066494275',display_name='tempest-VolumesSnapshotTestJSON-instance-1066494275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1066494275',id=45,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoSRGhz95pVW6Uz/ZW/NddkB+dH5Zizy836Qyi3cuwqSiJguTt4X37KPnLJ+Ao1rcRaP3Lv12o1KrpqD4zW7jKt6zv+UICWSxQZ4KcYi6/4XbN/miPIy9NtN5ySsiCNtw==',key_name='tempest-keypair-593401585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af75edfbd8534a9c84575464a28cdb67',ramdisk_id='',reservation_id='r-bevb8100',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-568043323',owner_user_name='tempest-VolumesSnapshotTestJSON-568043323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58361e4852e8467790067d63012c7ac1',uuid=7cd92c00-7b80-4582-9ab1-da081b64fc41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converting VIF {"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fe:37,bridge_name='br-int',has_traffic_filtering=True,id=e8c465c8-351b-4050-b925-d21de30fbb70,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c465c8-35') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.objects.instance [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cd92c00-7b80-4582-9ab1-da081b64fc41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:32:22 user nova-compute[72426]:   <uuid>7cd92c00-7b80-4582-9ab1-da081b64fc41</uuid>
Aug 01 08:32:22 user nova-compute[72426]:   <name>instance-0000002d</name>
Aug 01 08:32:22 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:32:22 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:32:22 user nova-compute[72426]:   <metadata>
Aug 01 08:32:22 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:32:22 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:32:22 user nova-compute[72426]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1066494275</nova:name>
Aug 01 08:32:22 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:32:22</nova:creationTime>
Aug 01 08:32:22 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:32:22 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:32:22 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:32:22 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:32:22 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:32:22 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:32:22 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:32:22 user nova-compute[72426]:       <nova:owner>
Aug 01 08:32:22 user nova-compute[72426]:         <nova:user uuid="58361e4852e8467790067d63012c7ac1">tempest-VolumesSnapshotTestJSON-568043323-project-member</nova:user>
Aug 01 08:32:22 user nova-compute[72426]:         <nova:project uuid="af75edfbd8534a9c84575464a28cdb67">tempest-VolumesSnapshotTestJSON-568043323</nova:project>
Aug 01 08:32:22 user nova-compute[72426]:       </nova:owner>
Aug 01 08:32:22 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:32:22 user nova-compute[72426]:       <nova:ports>
Aug 01 08:32:22 user nova-compute[72426]:         <nova:port uuid="e8c465c8-351b-4050-b925-d21de30fbb70">
Aug 01 08:32:22 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 08:32:22 user nova-compute[72426]:         </nova:port>
Aug 01 08:32:22 user nova-compute[72426]:       </nova:ports>
Aug 01 08:32:22 user nova-compute[72426]:     </nova:instance>
Aug 01 08:32:22 user nova-compute[72426]:   </metadata>
Aug 01 08:32:22 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:32:22 user nova-compute[72426]:     <system>
Aug 01 08:32:22 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:32:22 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:32:22 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:32:22 user nova-compute[72426]:       <entry name="serial">7cd92c00-7b80-4582-9ab1-da081b64fc41</entry>
Aug 01 08:32:22 user nova-compute[72426]:       <entry name="uuid">7cd92c00-7b80-4582-9ab1-da081b64fc41</entry>
Aug 01 08:32:22 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:32:22 user nova-compute[72426]:     </system>
Aug 01 08:32:22 user nova-compute[72426]:   </sysinfo>
Aug 01 08:32:22 user nova-compute[72426]:   <os>
Aug 01 08:32:22 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:32:22 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:32:22 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:32:22 user nova-compute[72426]:   </os>
Aug 01 08:32:22 user nova-compute[72426]:   <features>
Aug 01 08:32:22 user nova-compute[72426]:     <acpi/>
Aug 01 08:32:22 user nova-compute[72426]:     <apic/>
Aug 01 08:32:22 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:32:22 user nova-compute[72426]:   </features>
Aug 01 08:32:22 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:32:22 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:32:22 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:32:22 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:32:22 user nova-compute[72426]:   </clock>
Aug 01 08:32:22 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:32:22 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:32:22 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:32:22 user nova-compute[72426]:   </cpu>
Aug 01 08:32:22 user nova-compute[72426]:   <devices>
Aug 01 08:32:22 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:32:22 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:32:22 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk"/>
Aug 01 08:32:22 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:32:22 user nova-compute[72426]:     </disk>
Aug 01 08:32:22 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:32:22 user nova-compute[72426]:       <mac address="fa:16:3e:3c:fe:37"/>
Aug 01 08:32:22 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:32:22 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:32:22 user nova-compute[72426]:       <target dev="tape8c465c8-35"/>
Aug 01 08:32:22 user nova-compute[72426]:     </interface>
Aug 01 08:32:22 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:32:22 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/console.log" append="off"/>
Aug 01 08:32:22 user nova-compute[72426]:     </serial>
Aug 01 08:32:22 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:32:22 user nova-compute[72426]:     <video>
Aug 01 08:32:22 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:32:22 user nova-compute[72426]:     </video>
Aug 01 08:32:22 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:32:22 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:32:22 user nova-compute[72426]:     </rng>
Aug 01 08:32:22 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:32:22 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:32:22 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:32:22 user nova-compute[72426]:     </memballoon>
Aug 01 08:32:22 user nova-compute[72426]:   </devices>
Aug 01 08:32:22 user nova-compute[72426]: </domain>
Aug 01 08:32:22 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1066494275',display_name='tempest-VolumesSnapshotTestJSON-instance-1066494275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1066494275',id=45,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoSRGhz95pVW6Uz/ZW/NddkB+dH5Zizy836Qyi3cuwqSiJguTt4X37KPnLJ+Ao1rcRaP3Lv12o1KrpqD4zW7jKt6zv+UICWSxQZ4KcYi6/4XbN/miPIy9NtN5ySsiCNtw==',key_name='tempest-keypair-593401585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af75edfbd8534a9c84575464a28cdb67',ramdisk_id='',reservation_id='r-bevb8100',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-568043323',owner_user_name='tempest-VolumesSnapshotTestJSON-568043323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58361e4852e8467790067d63012c7ac1',uuid=7cd92c00-7b80-4582-9ab1-da081b64fc41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converting VIF {"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fe:37,bridge_name='br-int',has_traffic_filtering=True,id=e8c465c8-351b-4050-b925-d21de30fbb70,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c465c8-35') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG os_vif [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fe:37,bridge_name='br-int',has_traffic_filtering=True,id=e8c465c8-351b-4050-b925-d21de30fbb70,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c465c8-35') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8c465c8-35, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8c465c8-35, col_values=(('external_ids', {'iface-id': 'e8c465c8-351b-4050-b925-d21de30fbb70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:fe:37', 'vm-uuid': '7cd92c00-7b80-4582-9ab1-da081b64fc41'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:22 user nova-compute[72426]: INFO os_vif [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fe:37,bridge_name='br-int',has_traffic_filtering=True,id=e8c465c8-351b-4050-b925-d21de30fbb70,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c465c8-35')
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] No VIF found with MAC fa:16:3e:3c:fe:37, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.network.neutron [req-8841f871-d126-469f-9a75-2c29b30a3db6 req-6bb2d7b7-5acc-484f-9f55-77d8a1994af7 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Updated VIF entry in instance network info cache for port e8c465c8-351b-4050-b925-d21de30fbb70. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG nova.network.neutron [req-8841f871-d126-469f-9a75-2c29b30a3db6 req-6bb2d7b7-5acc-484f-9f55-77d8a1994af7 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Updating instance_info_cache with network_info: [{"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-8841f871-d126-469f-9a75-2c29b30a3db6 req-6bb2d7b7-5acc-484f-9f55-77d8a1994af7 service nova] Releasing lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:32:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-83f5720f-7657-4a65-8976-cc8b5b5c6e00 req-0a25bc98-1d99-4a74-bab9-be2411913660 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received event network-vif-plugged-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:32:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-83f5720f-7657-4a65-8976-cc8b5b5c6e00 req-0a25bc98-1d99-4a74-bab9-be2411913660 service nova] Acquiring lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-83f5720f-7657-4a65-8976-cc8b5b5c6e00 req-0a25bc98-1d99-4a74-bab9-be2411913660 service nova] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-83f5720f-7657-4a65-8976-cc8b5b5c6e00 req-0a25bc98-1d99-4a74-bab9-be2411913660 service nova] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:23 user nova-compute[72426]: DEBUG nova.compute.manager [req-83f5720f-7657-4a65-8976-cc8b5b5c6e00 req-0a25bc98-1d99-4a74-bab9-be2411913660 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] No waiting events found dispatching network-vif-plugged-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:32:23 user nova-compute[72426]: WARNING nova.compute.manager [req-83f5720f-7657-4a65-8976-cc8b5b5c6e00 req-0a25bc98-1d99-4a74-bab9-be2411913660 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received unexpected event network-vif-plugged-e8c465c8-351b-4050-b925-d21de30fbb70 for instance with vm_state building and task_state spawning.
Aug 01 08:32:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878745.926888, 7cd92c00-7b80-4582-9ab1-da081b64fc41 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:32:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] VM Resumed (Lifecycle Event)
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:32:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Instance spawned successfully.
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:32:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878745.9294271, 7cd92c00-7b80-4582-9ab1-da081b64fc41 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:32:25 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] VM Started (Lifecycle Event)
Aug 01 08:32:25 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:32:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:32:26 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:32:26 user nova-compute[72426]: INFO nova.compute.manager [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 01 08:32:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:32:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-ae8a920e-3a27-44b4-9664-6d686e45de92 req-f8dd390a-2fd4-4edf-80bd-e7dafc317050 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received event network-vif-plugged-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:32:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ae8a920e-3a27-44b4-9664-6d686e45de92 req-f8dd390a-2fd4-4edf-80bd-e7dafc317050 service nova] Acquiring lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ae8a920e-3a27-44b4-9664-6d686e45de92 req-f8dd390a-2fd4-4edf-80bd-e7dafc317050 service nova] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ae8a920e-3a27-44b4-9664-6d686e45de92 req-f8dd390a-2fd4-4edf-80bd-e7dafc317050 service nova] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-ae8a920e-3a27-44b4-9664-6d686e45de92 req-f8dd390a-2fd4-4edf-80bd-e7dafc317050 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] No waiting events found dispatching network-vif-plugged-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:32:26 user nova-compute[72426]: WARNING nova.compute.manager [req-ae8a920e-3a27-44b4-9664-6d686e45de92 req-f8dd390a-2fd4-4edf-80bd-e7dafc317050 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received unexpected event network-vif-plugged-e8c465c8-351b-4050-b925-d21de30fbb70 for instance with vm_state building and task_state spawning.
Aug 01 08:32:26 user nova-compute[72426]: INFO nova.compute.manager [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Took 6.69 seconds to build instance.
Aug 01 08:32:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-eecc6e7c-bb08-43e8-9a3c-05d2ea6b3b46 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.787s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:35 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:35 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:32:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:35 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:32:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:35 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:37 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:32:37 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:32:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8236MB free_disk=25.370899200439453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 8fff7c8e-8129-40f3-ac3b-9b60408705ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 1307ee99-42c0-4086-b8b1-120630450f5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 81bf3e66-4c1d-46df-8756-b438aab31e1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 7cd92c00-7b80-4582-9ab1-da081b64fc41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:32:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:32:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:32:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:32:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:43 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:32:44 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:32:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:32:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:32:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:32:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "1307ee99-42c0-4086-b8b1-120630450f5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:48 user nova-compute[72426]: INFO nova.compute.manager [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Terminating instance
Aug 01 08:32:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:32:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-e4bad9c7-56b3-470f-823a-7d738887f01c req-5b3a63f9-4660-4623-bedf-4caf79326269 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received event network-vif-unplugged-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e4bad9c7-56b3-470f-823a-7d738887f01c req-5b3a63f9-4660-4623-bedf-4caf79326269 service nova] Acquiring lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e4bad9c7-56b3-470f-823a-7d738887f01c req-5b3a63f9-4660-4623-bedf-4caf79326269 service nova] Lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-e4bad9c7-56b3-470f-823a-7d738887f01c req-5b3a63f9-4660-4623-bedf-4caf79326269 service nova] Lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-e4bad9c7-56b3-470f-823a-7d738887f01c req-5b3a63f9-4660-4623-bedf-4caf79326269 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] No waiting events found dispatching network-vif-unplugged-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-e4bad9c7-56b3-470f-823a-7d738887f01c req-5b3a63f9-4660-4623-bedf-4caf79326269 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received event network-vif-unplugged-0976b526-dfa9-4ba0-8156-047450df099c for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Instance destroyed successfully.
Aug 01 08:32:49 user nova-compute[72426]: DEBUG nova.objects.instance [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'resources' on Instance uuid 1307ee99-42c0-4086-b8b1-120630450f5c {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1423946976',display_name='tempest-AttachVolumeNegativeTest-server-1423946976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1423946976',id=41,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZTuatl5B5cLBf9vmWv3lBlVAYut/Cz7E4UuOF//ES+ixDQlhoR0zZM5uP4WfIve3SYcVGS48mJUYFxkQpBVsaKvziFzw5nbC09YRI/YtNlnH5KU1A9rGGSDiVVhgvuLQ==',key_name='tempest-keypair-338690452',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:27:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-uwxgk7ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=1307ee99-42c0-4086-b8b1-120630450f5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "0976b526-dfa9-4ba0-8156-047450df099c", "address": "fa:16:3e:f9:22:47", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0976b526-df", "ovs_interfaceid": "0976b526-dfa9-4ba0-8156-047450df099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:22:47,bridge_name='br-int',has_traffic_filtering=True,id=0976b526-dfa9-4ba0-8156-047450df099c,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976b526-df') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG os_vif [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:22:47,bridge_name='br-int',has_traffic_filtering=True,id=0976b526-dfa9-4ba0-8156-047450df099c,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976b526-df') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0976b526-df, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:32:49 user nova-compute[72426]: INFO os_vif [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:22:47,bridge_name='br-int',has_traffic_filtering=True,id=0976b526-dfa9-4ba0-8156-047450df099c,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0976b526-df')
Aug 01 08:32:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Deleting instance files /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c_del
Aug 01 08:32:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Deletion of /opt/stack/data/nova/instances/1307ee99-42c0-4086-b8b1-120630450f5c_del complete
Aug 01 08:32:49 user nova-compute[72426]: INFO nova.compute.manager [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 08:32:49 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:32:49 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:32:50 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:32:50 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:32:50 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Took 1.15 seconds to deallocate network for instance.
Aug 01 08:32:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-4321487f-d8c7-47b0-a2e8-10b06c13bcd4 req-d4d5a6a2-7350-4528-949c-a5126e257161 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received event network-vif-deleted-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:32:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:51 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Deleted allocations for instance 1307ee99-42c0-4086-b8b1-120630450f5c
Aug 01 08:32:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-594cdef5-234b-4096-a6a5-d77aa4b0898f req-f4295be0-56ca-4d7a-8546-b93c7744ef17 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received event network-vif-plugged-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-594cdef5-234b-4096-a6a5-d77aa4b0898f req-f4295be0-56ca-4d7a-8546-b93c7744ef17 service nova] Acquiring lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-594cdef5-234b-4096-a6a5-d77aa4b0898f req-f4295be0-56ca-4d7a-8546-b93c7744ef17 service nova] Lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-594cdef5-234b-4096-a6a5-d77aa4b0898f req-f4295be0-56ca-4d7a-8546-b93c7744ef17 service nova] Lock "1307ee99-42c0-4086-b8b1-120630450f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-594cdef5-234b-4096-a6a5-d77aa4b0898f req-f4295be0-56ca-4d7a-8546-b93c7744ef17 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] No waiting events found dispatching network-vif-plugged-0976b526-dfa9-4ba0-8156-047450df099c {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:32:51 user nova-compute[72426]: WARNING nova.compute.manager [req-594cdef5-234b-4096-a6a5-d77aa4b0898f req-f4295be0-56ca-4d7a-8546-b93c7744ef17 service nova] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Received unexpected event network-vif-plugged-0976b526-dfa9-4ba0-8156-047450df099c for instance with vm_state deleted and task_state None.
Aug 01 08:32:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-41ce2ac1-ae5f-45e8-9a47-aa29a8410799 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "1307ee99-42c0-4086-b8b1-120630450f5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-3e89f0f5-c312-4bf5-88e3-7e1b97b89785 req-81fae0ad-bcc1-4af3-9df3-3406a41ad94c service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received event network-changed-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-3e89f0f5-c312-4bf5-88e3-7e1b97b89785 req-81fae0ad-bcc1-4af3-9df3-3406a41ad94c service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Refreshing instance network info cache due to event network-changed-f441a355-3ad1-4c5a-8062-fc376068e465. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3e89f0f5-c312-4bf5-88e3-7e1b97b89785 req-81fae0ad-bcc1-4af3-9df3-3406a41ad94c service nova] Acquiring lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3e89f0f5-c312-4bf5-88e3-7e1b97b89785 req-81fae0ad-bcc1-4af3-9df3-3406a41ad94c service nova] Acquired lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:32:51 user nova-compute[72426]: DEBUG nova.network.neutron [req-3e89f0f5-c312-4bf5-88e3-7e1b97b89785 req-81fae0ad-bcc1-4af3-9df3-3406a41ad94c service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Refreshing network info cache for port f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:32:52 user nova-compute[72426]: DEBUG nova.network.neutron [req-3e89f0f5-c312-4bf5-88e3-7e1b97b89785 req-81fae0ad-bcc1-4af3-9df3-3406a41ad94c service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updated VIF entry in instance network info cache for port f441a355-3ad1-4c5a-8062-fc376068e465. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:32:52 user nova-compute[72426]: DEBUG nova.network.neutron [req-3e89f0f5-c312-4bf5-88e3-7e1b97b89785 req-81fae0ad-bcc1-4af3-9df3-3406a41ad94c service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating instance_info_cache with network_info: [{"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:32:52 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3e89f0f5-c312-4bf5-88e3-7e1b97b89785 req-81fae0ad-bcc1-4af3-9df3-3406a41ad94c service nova] Releasing lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:32:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:53 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:32:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG nova.objects.instance [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:32:56 user nova-compute[72426]: INFO nova.compute.manager [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attaching volume 41df57ed-31e3-452d-a192-2f6b711ea9f8 to /dev/vdb
Aug 01 08:32:56 user nova-compute[72426]: DEBUG os_brick.utils [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c07b842-aff1-45ab-bd87-88673189ec05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea61ad1-cb38-46e4-8b64-ea5f75b41cf1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab13fe8-9cb5-4417-b3f9-100641859a78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c59587-0142-4b82-a894-f5f86ab7d9a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:32:56 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:32:56 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[75037ebc-07ec-49a9-aeae-66292ce56faf]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG os_brick.utils [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:32:56 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating existing volume attachment record: 11d557cf-4bdf-48e8-911a-b03c88c0c373 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:32:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:32:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOCnIJtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:33:04 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:33:04 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:33:04 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7fdc78-d9c6-4db2-b295-be8813e6619a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:33:04 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[403f083b-0de0-44cb-9411-472c83cb1d40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8] added
Aug 01 08:33:04 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[248347db-c806-4e4a-8973-03056d8ab178]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c063dc93-6b95-4640-981c-5bf2fa78df2a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOCnIJtM {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOCnIJtM" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61c0b92-0ab6-4722-a123-6bd63f83a64e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HOCnIJtM'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c936bc0c-a485-40eb-80ff-3aa76b74c461]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a5f0a8-c665-4e80-b1a8-1a152cc7d906]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:33:04 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:33:04 user nova-compute[72426]:  {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:33:04 user nova-compute[72426]: WARNING os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 08:33:04 user nova-compute[72426]: 
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cca2de-d6ce-463b-a510-f18eaf0a038b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8, portal: 172.16.0.220,3260]
Aug 01 08:33:04 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8, portal: 172.16.0.220,3260] successful.
Aug 01 08:33:04 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da29cf-95f7-4c2c-a13f-3ac8da1b7f93]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[83546eca-48a3-421a-b33c-77edbc3e847c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 (non-flash)
Aug 01 08:33:04 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 (non-flash)
Aug 01 08:33:04 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8afcaa4-0ffb-40ef-b2c4-f6dcac29c428]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOCnIJtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878769.6071417, 1307ee99-42c0-4086-b8b1-120630450f5c => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:33:04 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] VM Stopped (Lifecycle Event)
Aug 01 08:33:04 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9ced9fa2-87da-452c-a460-4b4157030eb9 None None] [instance: 1307ee99-42c0-4086-b8b1-120630450f5c] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:33:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:33:05 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26138313163396637', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:33:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138313163396637', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:33:05 user nova-compute[72426]: DEBUG nova.objects.instance [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:33:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:33:05 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:33:05 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:33:05 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:33:05 user nova-compute[72426]:   <serial>41df57ed-31e3-452d-a192-2f6b711ea9f8</serial>
Aug 01 08:33:05 user nova-compute[72426]: </disk>
Aug 01 08:33:05 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:33:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:33:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:33:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No VIF found with MAC fa:16:3e:d3:93:15, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:33:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-13807c23-523b-4dbb-8f50-b80a98bd3303 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.277s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:06 user nova-compute[72426]: INFO nova.compute.manager [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Terminating instance
Aug 01 08:33:06 user nova-compute[72426]: DEBUG nova.compute.manager [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-6e1272a7-f751-44ed-bc22-e273a35d4794 req-19890f67-277d-4ade-9169-31a1839e07a9 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Received event network-vif-unplugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6e1272a7-f751-44ed-bc22-e273a35d4794 req-19890f67-277d-4ade-9169-31a1839e07a9 service nova] Acquiring lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6e1272a7-f751-44ed-bc22-e273a35d4794 req-19890f67-277d-4ade-9169-31a1839e07a9 service nova] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6e1272a7-f751-44ed-bc22-e273a35d4794 req-19890f67-277d-4ade-9169-31a1839e07a9 service nova] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-6e1272a7-f751-44ed-bc22-e273a35d4794 req-19890f67-277d-4ade-9169-31a1839e07a9 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] No waiting events found dispatching network-vif-unplugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:33:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-6e1272a7-f751-44ed-bc22-e273a35d4794 req-19890f67-277d-4ade-9169-31a1839e07a9 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Received event network-vif-unplugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:33:06 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Instance destroyed successfully.
Aug 01 08:33:06 user nova-compute[72426]: DEBUG nova.objects.instance [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lazy-loading 'resources' on Instance uuid 8fff7c8e-8129-40f3-ac3b-9b60408705ac {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:24:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2048416265',display_name='tempest-ServersNegativeTestJSON-server-2048416265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2048416265',id=37,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:24:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9859557c06bf4d50937390421acca14f',ramdisk_id='',reservation_id='r-x1y403o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-330621956',owner_user_name='tempest-ServersNegativeTestJSON-330621956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:24:22Z,user_data=None,user_id='6db1631e91f1462c9a1433fc10eba8bf',uuid=8fff7c8e-8129-40f3-ac3b-9b60408705ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converting VIF {"id": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "address": "fa:16:3e:1f:2d:65", "network": {"id": "025b883c-c5ac-428a-8309-a808e4b75994", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1181399519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9859557c06bf4d50937390421acca14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cad54db-90", "ovs_interfaceid": "5cad54db-906a-4055-8d25-6a1857cbf6d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=5cad54db-906a-4055-8d25-6a1857cbf6d2,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cad54db-90') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG os_vif [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=5cad54db-906a-4055-8d25-6a1857cbf6d2,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cad54db-90') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cad54db-90, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:33:07 user nova-compute[72426]: INFO os_vif [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:2d:65,bridge_name='br-int',has_traffic_filtering=True,id=5cad54db-906a-4055-8d25-6a1857cbf6d2,network=Network(025b883c-c5ac-428a-8309-a808e4b75994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cad54db-90')
Aug 01 08:33:07 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Deleting instance files /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac_del
Aug 01 08:33:07 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Deletion of /opt/stack/data/nova/instances/8fff7c8e-8129-40f3-ac3b-9b60408705ac_del complete
Aug 01 08:33:07 user nova-compute[72426]: INFO nova.compute.manager [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 01 08:33:07 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:33:07 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Took 0.52 seconds to deallocate network for instance.
Aug 01 08:33:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:07 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Deleted allocations for instance 8fff7c8e-8129-40f3-ac3b-9b60408705ac
Aug 01 08:33:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-64361ecb-d0ff-47b9-91b7-38d0caaed3dd tempest-ServersNegativeTestJSON-330621956 tempest-ServersNegativeTestJSON-330621956-project-member] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.935s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-f140ee27-358b-4740-a591-42f6696542e8 req-82202d35-d96f-44ba-9fbc-b0945af332c5 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Received event network-vif-plugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:33:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f140ee27-358b-4740-a591-42f6696542e8 req-82202d35-d96f-44ba-9fbc-b0945af332c5 service nova] Acquiring lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f140ee27-358b-4740-a591-42f6696542e8 req-82202d35-d96f-44ba-9fbc-b0945af332c5 service nova] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f140ee27-358b-4740-a591-42f6696542e8 req-82202d35-d96f-44ba-9fbc-b0945af332c5 service nova] Lock "8fff7c8e-8129-40f3-ac3b-9b60408705ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-f140ee27-358b-4740-a591-42f6696542e8 req-82202d35-d96f-44ba-9fbc-b0945af332c5 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] No waiting events found dispatching network-vif-plugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:33:08 user nova-compute[72426]: WARNING nova.compute.manager [req-f140ee27-358b-4740-a591-42f6696542e8 req-82202d35-d96f-44ba-9fbc-b0945af332c5 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Received unexpected event network-vif-plugged-5cad54db-906a-4055-8d25-6a1857cbf6d2 for instance with vm_state deleted and task_state None.
Aug 01 08:33:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-f140ee27-358b-4740-a591-42f6696542e8 req-82202d35-d96f-44ba-9fbc-b0945af332c5 service nova] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Received event network-vif-deleted-5cad54db-906a-4055-8d25-6a1857cbf6d2 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:33:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:21 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878786.9797738, 8fff7c8e-8129-40f3-ac3b-9b60408705ac => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:33:21 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] VM Stopped (Lifecycle Event)
Aug 01 08:33:22 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3b1bd3db-ccf4-4e29-9042-1a965a49dfd6 None None] [instance: 8fff7c8e-8129-40f3-ac3b-9b60408705ac] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:33:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:24 user nova-compute[72426]: INFO nova.compute.manager [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Detaching volume 41df57ed-31e3-452d-a192-2f6b711ea9f8
Aug 01 08:33:24 user nova-compute[72426]: INFO nova.virt.block_device [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attempting to driver detach volume 41df57ed-31e3-452d-a192-2f6b711ea9f8 from mountpoint /dev/vdb
Aug 01 08:33:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Attempting to detach device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:33:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:33:24 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:33:24 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:33:24 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:33:24 user nova-compute[72426]:   <serial>41df57ed-31e3-452d-a192-2f6b711ea9f8</serial>
Aug 01 08:33:24 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:33:24 user nova-compute[72426]: </disk>
Aug 01 08:33:24 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:33:24 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Successfully detached device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the persistent domain config.
Aug 01 08:33:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:33:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:33:24 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:33:24 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:33:24 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:33:24 user nova-compute[72426]:   <serial>41df57ed-31e3-452d-a192-2f6b711ea9f8</serial>
Aug 01 08:33:24 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:33:24 user nova-compute[72426]: </disk>
Aug 01 08:33:24 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878805.4550955, 81bf3e66-4c1d-46df-8756-b438aab31e1e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:33:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Successfully detached device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the live domain config.
Aug 01 08:33:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOCnIJtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:33:25 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb54412f-4e83-418e-aac6-cdc0f2aab398]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afbde50-ce19-4fd4-a2fe-45c005d0cc55]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 (non-flash)
Aug 01 08:33:25 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 (non-flash)
Aug 01 08:33:25 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38e6ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[560ff53d-a776-4a50-8f53-991966025fac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[379853cf-76d8-4801-9c1d-6cdedb3220b6]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f56db86-8c67-4101-858e-d62a71bc0689]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[15683df0-6b05-4086-87e2-f925fb2bc277]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb9c6aa-e5d4-4f7e-ab58-8d6e2758d85e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e61905-039d-4838-a0de-bedb584b98d2]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8, portal: 172.16.0.220,3260]
Aug 01 08:33:25 user nova-compute[72426]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8, portal: 172.16.0.220,3260] successful.
Aug 01 08:33:25 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41df57ed-31e3-452d-a192-2f6b711ea9f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b7a5b4-593c-4a10-8f57-fc505b457e3d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== disconnect_volume: return (278ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:33:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:33:26 user nova-compute[72426]: DEBUG nova.objects.instance [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:33:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-b3e5821f-0361-45af-b6a0-50925cff2b7a tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:36 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:37 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:33:37 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:33:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8483MB free_disk=25.38787841796875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 81bf3e66-4c1d-46df-8756-b438aab31e1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 7cd92c00-7b80-4582-9ab1-da081b64fc41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:33:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:40 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:33:43 user nova-compute[72426]: INFO nova.compute.claims [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Claim successful on node user
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:33:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.policy [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53c85b986ed140c491cd0ed264e561c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d23fc511343c698af4392fc3de94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:33:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Creating image(s)
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "/opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "/opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Skipping network cache update for instance because it is Building. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG nova.objects.instance [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lazy-loading 'info_cache' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk 1073741824" returned: 0 in 0.061s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Cannot resize image /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG nova.objects.instance [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'migration_context' on Instance uuid 6fd5c82f-6b6e-48d8-a977-af76a121cd5d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Ensure instance console log exists: /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:44 user nova-compute[72426]: DEBUG nova.network.neutron [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Successfully created port: 7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating instance_info_cache with network_info: [{"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Successfully updated port: 7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "refresh_cache-6fd5c82f-6b6e-48d8-a977-af76a121cd5d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquired lock "refresh_cache-6fd5c82f-6b6e-48d8-a977-af76a121cd5d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-2406dd02-9ff8-4eb3-9d31-09edd35ed1b6 req-fc8c8d1f-585e-4257-b955-790d40b0b723 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received event network-changed-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-2406dd02-9ff8-4eb3-9d31-09edd35ed1b6 req-fc8c8d1f-585e-4257-b955-790d40b0b723 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Refreshing instance network info cache due to event network-changed-7c6e3391-ff14-484f-b749-0743a1278469. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2406dd02-9ff8-4eb3-9d31-09edd35ed1b6 req-fc8c8d1f-585e-4257-b955-790d40b0b723 service nova] Acquiring lock "refresh_cache-6fd5c82f-6b6e-48d8-a977-af76a121cd5d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:33:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Updating instance_info_cache with network_info: [{"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Releasing lock "refresh_cache-6fd5c82f-6b6e-48d8-a977-af76a121cd5d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Instance network_info: |[{"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2406dd02-9ff8-4eb3-9d31-09edd35ed1b6 req-fc8c8d1f-585e-4257-b955-790d40b0b723 service nova] Acquired lock "refresh_cache-6fd5c82f-6b6e-48d8-a977-af76a121cd5d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.network.neutron [req-2406dd02-9ff8-4eb3-9d31-09edd35ed1b6 req-fc8c8d1f-585e-4257-b955-790d40b0b723 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Refreshing network info cache for port 7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Start _get_guest_xml network_info=[{"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:33:46 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:33:46 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1279142521',display_name='tempest-AttachVolumeNegativeTest-server-1279142521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1279142521',id=46,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhWNwcP2Nif+SwcAoVauoL89WbZVYCbB1HuKbWY30gQsusGbGrcmJUg5HUfpe1TZiq82JxrbQ+yPwIfJE+xpbrMwIJSvWZYyyEoD+mAghqV/mMh185+UTn0ubbkAv+Zmw==',key_name='tempest-keypair-2030940746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-f7tcm9kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=6fd5c82f-6b6e-48d8-a977-af76a121cd5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:00:4f,bridge_name='br-int',has_traffic_filtering=True,id=7c6e3391-ff14-484f-b749-0743a1278469,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6e3391-ff') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fd5c82f-6b6e-48d8-a977-af76a121cd5d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:33:46 user nova-compute[72426]:   <uuid>6fd5c82f-6b6e-48d8-a977-af76a121cd5d</uuid>
Aug 01 08:33:46 user nova-compute[72426]:   <name>instance-0000002e</name>
Aug 01 08:33:46 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:33:46 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:33:46 user nova-compute[72426]:   <metadata>
Aug 01 08:33:46 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:33:46 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:33:46 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1279142521</nova:name>
Aug 01 08:33:46 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:33:46</nova:creationTime>
Aug 01 08:33:46 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:33:46 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:33:46 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:33:46 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:33:46 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:33:46 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:33:46 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:33:46 user nova-compute[72426]:       <nova:owner>
Aug 01 08:33:46 user nova-compute[72426]:         <nova:user uuid="53c85b986ed140c491cd0ed264e561c7">tempest-AttachVolumeNegativeTest-1212503363-project-member</nova:user>
Aug 01 08:33:46 user nova-compute[72426]:         <nova:project uuid="0d0d23fc511343c698af4392fc3de94b">tempest-AttachVolumeNegativeTest-1212503363</nova:project>
Aug 01 08:33:46 user nova-compute[72426]:       </nova:owner>
Aug 01 08:33:46 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:33:46 user nova-compute[72426]:       <nova:ports>
Aug 01 08:33:46 user nova-compute[72426]:         <nova:port uuid="7c6e3391-ff14-484f-b749-0743a1278469">
Aug 01 08:33:46 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 08:33:46 user nova-compute[72426]:         </nova:port>
Aug 01 08:33:46 user nova-compute[72426]:       </nova:ports>
Aug 01 08:33:46 user nova-compute[72426]:     </nova:instance>
Aug 01 08:33:46 user nova-compute[72426]:   </metadata>
Aug 01 08:33:46 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:33:46 user nova-compute[72426]:     <system>
Aug 01 08:33:46 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:33:46 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:33:46 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:33:46 user nova-compute[72426]:       <entry name="serial">6fd5c82f-6b6e-48d8-a977-af76a121cd5d</entry>
Aug 01 08:33:46 user nova-compute[72426]:       <entry name="uuid">6fd5c82f-6b6e-48d8-a977-af76a121cd5d</entry>
Aug 01 08:33:46 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:33:46 user nova-compute[72426]:     </system>
Aug 01 08:33:46 user nova-compute[72426]:   </sysinfo>
Aug 01 08:33:46 user nova-compute[72426]:   <os>
Aug 01 08:33:46 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:33:46 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:33:46 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:33:46 user nova-compute[72426]:   </os>
Aug 01 08:33:46 user nova-compute[72426]:   <features>
Aug 01 08:33:46 user nova-compute[72426]:     <acpi/>
Aug 01 08:33:46 user nova-compute[72426]:     <apic/>
Aug 01 08:33:46 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:33:46 user nova-compute[72426]:   </features>
Aug 01 08:33:46 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:33:46 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:33:46 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:33:46 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:33:46 user nova-compute[72426]:   </clock>
Aug 01 08:33:46 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:33:46 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:33:46 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:33:46 user nova-compute[72426]:   </cpu>
Aug 01 08:33:46 user nova-compute[72426]:   <devices>
Aug 01 08:33:46 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:33:46 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:33:46 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk"/>
Aug 01 08:33:46 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:33:46 user nova-compute[72426]:     </disk>
Aug 01 08:33:46 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:33:46 user nova-compute[72426]:       <mac address="fa:16:3e:7a:00:4f"/>
Aug 01 08:33:46 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:33:46 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:33:46 user nova-compute[72426]:       <target dev="tap7c6e3391-ff"/>
Aug 01 08:33:46 user nova-compute[72426]:     </interface>
Aug 01 08:33:46 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:33:46 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/console.log" append="off"/>
Aug 01 08:33:46 user nova-compute[72426]:     </serial>
Aug 01 08:33:46 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:33:46 user nova-compute[72426]:     <video>
Aug 01 08:33:46 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:33:46 user nova-compute[72426]:     </video>
Aug 01 08:33:46 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:33:46 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:33:46 user nova-compute[72426]:     </rng>
Aug 01 08:33:46 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:33:46 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:33:46 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:33:46 user nova-compute[72426]:     </memballoon>
Aug 01 08:33:46 user nova-compute[72426]:   </devices>
Aug 01 08:33:46 user nova-compute[72426]: </domain>
Aug 01 08:33:46 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1279142521',display_name='tempest-AttachVolumeNegativeTest-server-1279142521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1279142521',id=46,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhWNwcP2Nif+SwcAoVauoL89WbZVYCbB1HuKbWY30gQsusGbGrcmJUg5HUfpe1TZiq82JxrbQ+yPwIfJE+xpbrMwIJSvWZYyyEoD+mAghqV/mMh185+UTn0ubbkAv+Zmw==',key_name='tempest-keypair-2030940746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-f7tcm9kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=6fd5c82f-6b6e-48d8-a977-af76a121cd5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:00:4f,bridge_name='br-int',has_traffic_filtering=True,id=7c6e3391-ff14-484f-b749-0743a1278469,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6e3391-ff') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG os_vif [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:00:4f,bridge_name='br-int',has_traffic_filtering=True,id=7c6e3391-ff14-484f-b749-0743a1278469,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6e3391-ff') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c6e3391-ff, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c6e3391-ff, col_values=(('external_ids', {'iface-id': '7c6e3391-ff14-484f-b749-0743a1278469', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:00:4f', 'vm-uuid': '6fd5c82f-6b6e-48d8-a977-af76a121cd5d'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:46 user nova-compute[72426]: INFO os_vif [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:00:4f,bridge_name='br-int',has_traffic_filtering=True,id=7c6e3391-ff14-484f-b749-0743a1278469,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6e3391-ff')
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No VIF found with MAC fa:16:3e:7a:00:4f, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.network.neutron [req-2406dd02-9ff8-4eb3-9d31-09edd35ed1b6 req-fc8c8d1f-585e-4257-b955-790d40b0b723 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Updated VIF entry in instance network info cache for port 7c6e3391-ff14-484f-b749-0743a1278469. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG nova.network.neutron [req-2406dd02-9ff8-4eb3-9d31-09edd35ed1b6 req-fc8c8d1f-585e-4257-b955-790d40b0b723 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Updating instance_info_cache with network_info: [{"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:33:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-2406dd02-9ff8-4eb3-9d31-09edd35ed1b6 req-fc8c8d1f-585e-4257-b955-790d40b0b723 service nova] Releasing lock "refresh_cache-6fd5c82f-6b6e-48d8-a977-af76a121cd5d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:33:47 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:33:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-069a5b98-f921-4af1-819b-275ee7d6e2d3 req-4b71bac6-c398-4684-a738-e77dce02e1af service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received event network-vif-plugged-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:33:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-069a5b98-f921-4af1-819b-275ee7d6e2d3 req-4b71bac6-c398-4684-a738-e77dce02e1af service nova] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-069a5b98-f921-4af1-819b-275ee7d6e2d3 req-4b71bac6-c398-4684-a738-e77dce02e1af service nova] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-069a5b98-f921-4af1-819b-275ee7d6e2d3 req-4b71bac6-c398-4684-a738-e77dce02e1af service nova] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:48 user nova-compute[72426]: DEBUG nova.compute.manager [req-069a5b98-f921-4af1-819b-275ee7d6e2d3 req-4b71bac6-c398-4684-a738-e77dce02e1af service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] No waiting events found dispatching network-vif-plugged-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:33:48 user nova-compute[72426]: WARNING nova.compute.manager [req-069a5b98-f921-4af1-819b-275ee7d6e2d3 req-4b71bac6-c398-4684-a738-e77dce02e1af service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received unexpected event network-vif-plugged-7c6e3391-ff14-484f-b749-0743a1278469 for instance with vm_state building and task_state spawning.
Aug 01 08:33:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878830.038594, 6fd5c82f-6b6e-48d8-a977-af76a121cd5d => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:33:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] VM Resumed (Lifecycle Event)
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:33:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Instance spawned successfully.
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:33:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878830.0431733, 6fd5c82f-6b6e-48d8-a977-af76a121cd5d => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:33:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] VM Started (Lifecycle Event)
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:33:50 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:33:50 user nova-compute[72426]: INFO nova.compute.manager [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:33:50 user nova-compute[72426]: INFO nova.compute.manager [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Took 7.06 seconds to build instance.
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-921b98dd-45ad-4986-aa13-1e616720e355 req-1dedfb23-841b-4443-8c3b-eb4dc195ca7a service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received event network-vif-plugged-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-921b98dd-45ad-4986-aa13-1e616720e355 req-1dedfb23-841b-4443-8c3b-eb4dc195ca7a service nova] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-921b98dd-45ad-4986-aa13-1e616720e355 req-1dedfb23-841b-4443-8c3b-eb4dc195ca7a service nova] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-921b98dd-45ad-4986-aa13-1e616720e355 req-1dedfb23-841b-4443-8c3b-eb4dc195ca7a service nova] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:50 user nova-compute[72426]: DEBUG nova.compute.manager [req-921b98dd-45ad-4986-aa13-1e616720e355 req-1dedfb23-841b-4443-8c3b-eb4dc195ca7a service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] No waiting events found dispatching network-vif-plugged-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:33:50 user nova-compute[72426]: WARNING nova.compute.manager [req-921b98dd-45ad-4986-aa13-1e616720e355 req-1dedfb23-841b-4443-8c3b-eb4dc195ca7a service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received unexpected event network-vif-plugged-7c6e3391-ff14-484f-b749-0743a1278469 for instance with vm_state active and task_state None.
Aug 01 08:33:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-544af9a7-e6b7-4dea-928a-a965728e6044 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.155s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:33:51 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:33:51 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:53 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:33:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:33:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-bf10800e-cbf1-414b-bc19-ebb3c87a1c1d req-428e8a96-5f2a-4bf3-9df2-7ab6dd8d6dc6 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received event network-changed-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:34:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-bf10800e-cbf1-414b-bc19-ebb3c87a1c1d req-428e8a96-5f2a-4bf3-9df2-7ab6dd8d6dc6 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Refreshing instance network info cache due to event network-changed-e8c465c8-351b-4050-b925-d21de30fbb70. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:34:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bf10800e-cbf1-414b-bc19-ebb3c87a1c1d req-428e8a96-5f2a-4bf3-9df2-7ab6dd8d6dc6 service nova] Acquiring lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:34:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bf10800e-cbf1-414b-bc19-ebb3c87a1c1d req-428e8a96-5f2a-4bf3-9df2-7ab6dd8d6dc6 service nova] Acquired lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:34:10 user nova-compute[72426]: DEBUG nova.network.neutron [req-bf10800e-cbf1-414b-bc19-ebb3c87a1c1d req-428e8a96-5f2a-4bf3-9df2-7ab6dd8d6dc6 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Refreshing network info cache for port e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG nova.objects.instance [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'flavor' on Instance uuid 7cd92c00-7b80-4582-9ab1-da081b64fc41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:34:11 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Ignoring supplied device name: /dev/vdb
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:11 user nova-compute[72426]: INFO nova.compute.manager [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Attaching volume a6ac3041-a6d0-4d21-99d4-cbda19793efb to /dev/vdb
Aug 01 08:34:11 user nova-compute[72426]: DEBUG nova.network.neutron [req-bf10800e-cbf1-414b-bc19-ebb3c87a1c1d req-428e8a96-5f2a-4bf3-9df2-7ab6dd8d6dc6 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Updated VIF entry in instance network info cache for port e8c465c8-351b-4050-b925-d21de30fbb70. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG nova.network.neutron [req-bf10800e-cbf1-414b-bc19-ebb3c87a1c1d req-428e8a96-5f2a-4bf3-9df2-7ab6dd8d6dc6 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Updating instance_info_cache with network_info: [{"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG os_brick.utils [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-bf10800e-cbf1-414b-bc19-ebb3c87a1c1d req-428e8a96-5f2a-4bf3-9df2-7ab6dd8d6dc6 service nova] Releasing lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed47fa69-0c25-41ee-911f-fe0fbc4ca0af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ce5f21-6253-49bf-a71b-087b36c46a3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf5b3db-225b-4ce8-ada6-29458af0681f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e557cb-a32d-4e4f-b604-08503512ff45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:34:11 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:34:11 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a28ef5-dc3a-48e8-97a0-b91c94e6f8ab]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG os_brick.utils [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Updating existing volume attachment record: 441812d2-257a-42e0-9a2e-f4fcecc0a3b8 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:34:11 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:16 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLTWgrES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:34:18 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:34:18 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:34:18 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b425bf6-8e92-482f-bd55-8d51d55d06c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:34:18 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af6d348-43d2-4e0e-8f16-eb25366d8517]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb] added
Aug 01 08:34:18 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12c7a19-28d4-402e-8019-43a0185a8cc3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a2327-40ea-46fa-94d6-42fc89174f57]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aLTWgrES {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aLTWgrES" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9755513c-accf-4578-8ea4-40dc6e0baf1e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aLTWgrES'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[89659f60-e138-46f5-bf3f-44600785192b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3889ba59-4918-4eab-be52-1a831d493833]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:34:18 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:34:18 user nova-compute[72426]:  {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:34:18 user nova-compute[72426]: WARNING os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 08:34:18 user nova-compute[72426]: 
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eecdd0-853c-4e08-bc0c-a4fbb652e9d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb, portal: 172.16.0.220,3260]
Aug 01 08:34:18 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb, portal: 172.16.0.220,3260] successful.
Aug 01 08:34:18 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ec7a3b-81dd-4117-9e9c-a2e62cebd4ad]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5d2a76-3334-43fc-bfed-5cc80483691a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:18 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:18 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.072s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eec0bf-e4fc-437b-a508-6e344bb1fcba]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:34:18 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLTWgrES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG nova.objects.instance [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:19 user nova-compute[72426]: INFO nova.compute.manager [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attaching volume 5576cffd-b71c-4260-9d87-5bf71f312b39 to /dev/vdb
Aug 01 08:34:19 user nova-compute[72426]: DEBUG os_brick.utils [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1b1de4-aa07-460a-8a20-77fe684ed747]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1753aebf-aa73-49fe-bf69-e191a01c0a8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb42b4-4f21-4235-a173-84d1d33a422f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cf160f-710f-4960-931f-4f1da270b064]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:34:19 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:34:19 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d24442-457b-4a2f-beb8-558467ee3a1c]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG os_brick.utils [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating existing volume attachment record: d3e93061-d7a4-4cd7-bb60-8976cbbd3ff6 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23630323863633836', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630323863633836', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG nova.objects.instance [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'flavor' on Instance uuid 7cd92c00-7b80-4582-9ab1-da081b64fc41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:34:19 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:34:19 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:34:19 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:34:19 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:34:19 user nova-compute[72426]:   <serial>a6ac3041-a6d0-4d21-99d4-cbda19793efb</serial>
Aug 01 08:34:19 user nova-compute[72426]: </disk>
Aug 01 08:34:19 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:34:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:34:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:34:20 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] No VIF found with MAC fa:16:3e:3c:fe:37, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:34:20 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9f45d94e-26ca-48a4-ba37-13af2c428a6e tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.335s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:21 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAPYcTGC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:34:27 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:34:27 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:34:27 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3aacd8-c12f-48cb-b38b-43975c073399]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:34:27 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[935daea4-4ca5-4f01-bda0-e650312c8daa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39] added
Aug 01 08:34:27 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3235e6-d7d3-47c4-8aca-70ea1ed64fbb]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7712a6ac-04dc-488f-a562-7b61980c2796]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAPYcTGC {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAPYcTGC" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0484cbd-ff03-4926-b838-3bf3bf54fc00]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAPYcTGC'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2472cc8-5014-4ac2-944a-17a93a287163]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28dfa5f-318f-41dc-8a45-53642bb6b82b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:27 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:27 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d503d4-c7f3-4e88-8eb6-d1e3d0b7e6c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39, portal: 172.16.0.220,3260]
Aug 01 08:34:27 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39, portal: 172.16.0.220,3260] successful.
Aug 01 08:34:27 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a678d3b4-a0f5-4fd1-a597-c1839a2a42e8]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6877bc24-a598-4d4e-95e9-2cbc98b98d25]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:27 user nova-compute[72426]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 (non-flash)
Aug 01 08:34:27 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:27 user nova-compute[72426]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 (non-flash)
Aug 01 08:34:27 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e2ee8d-b00a-4ce3-8012-4ebf31353d60]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:34:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAPYcTGC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:34:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:34:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23638643161353039', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:34:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638643161353039', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:34:28 user nova-compute[72426]: DEBUG nova.objects.instance [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:34:28 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:34:28 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:34:28 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:34:28 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:34:28 user nova-compute[72426]:   <serial>5576cffd-b71c-4260-9d87-5bf71f312b39</serial>
Aug 01 08:34:28 user nova-compute[72426]: </disk>
Aug 01 08:34:28 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:34:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:34:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:34:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No VIF found with MAC fa:16:3e:d3:93:15, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:34:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c6c100e8-d82c-426d-99ae-df5c71d49aa5 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.994s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:31 user nova-compute[72426]: INFO nova.compute.manager [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Detaching volume 5576cffd-b71c-4260-9d87-5bf71f312b39
Aug 01 08:34:31 user nova-compute[72426]: INFO nova.virt.block_device [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attempting to driver detach volume 5576cffd-b71c-4260-9d87-5bf71f312b39 from mountpoint /dev/vdb
Aug 01 08:34:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Attempting to detach device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:34:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:34:31 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:34:31 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:34:31 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:34:31 user nova-compute[72426]:   <serial>5576cffd-b71c-4260-9d87-5bf71f312b39</serial>
Aug 01 08:34:31 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:34:31 user nova-compute[72426]: </disk>
Aug 01 08:34:31 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:34:31 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Successfully detached device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the persistent domain config.
Aug 01 08:34:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:34:31 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:34:31 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:34:31 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:34:31 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:34:31 user nova-compute[72426]:   <serial>5576cffd-b71c-4260-9d87-5bf71f312b39</serial>
Aug 01 08:34:31 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:34:31 user nova-compute[72426]: </disk>
Aug 01 08:34:31 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878872.1259673, 81bf3e66-4c1d-46df-8756-b438aab31e1e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:34:32 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Successfully detached device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the live domain config.
Aug 01 08:34:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAPYcTGC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:34:32 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6b61fb-078e-47f0-8a35-af23214afe9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60855a-45ab-40ed-bcfa-384e4d8d2344]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:32 user nova-compute[72426]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 (non-flash)
Aug 01 08:34:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:32 user nova-compute[72426]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 (non-flash)
Aug 01 08:34:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c80653d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b4859a-5546-434b-8ae4-72a0f3028773]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb98452-8657-4ab2-a09b-2c76a736b3b0]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd07ad-1bcd-463c-87d1-77c48e28386a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb64414-ae1b-461e-b0cb-b0588c75e1c2]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7156662-4719-4e4c-afc1-b8f2d52ff2d5]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[864632b8-ab6e-4116-a01c-551dcd29a18b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39, portal: 172.16.0.220,3260]
Aug 01 08:34:32 user nova-compute[72426]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39, portal: 172.16.0.220,3260] successful.
Aug 01 08:34:32 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5576cffd-b71c-4260-9d87-5bf71f312b39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96672c5-0f22-45ed-9f1a-45a295d5e80e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== disconnect_volume: return (305ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:34:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:34:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:33 user nova-compute[72426]: DEBUG nova.objects.instance [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:34:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d2b0d18f-85dd-4d22-9d6f-9470c5aeec83 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:33 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:34:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:33 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:34:33 user nova-compute[72426]: INFO nova.compute.claims [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Claim successful on node user
Aug 01 08:34:34 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:34:34 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:34:34 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:34:34 user nova-compute[72426]: INFO nova.virt.block_device [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Booting with volume 17dd5f10-29eb-428c-afc0-fa602ea1c54b at /dev/vda
Aug 01 08:34:34 user nova-compute[72426]: DEBUG nova.policy [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afa99527453b4d92a9737db9a6e7e51a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a265b55817a4ee5abb5d363e09e53b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG os_brick.utils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8bef4b-a13c-46ae-a066-5171b26b46c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf36be1-a255-4f70-88c5-6d57a9e78af1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[326b86ef-72e2-466a-bd7a-ed757d861f7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ade3052-48a1-4823-84ea-8da3c6186b3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:34:34 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:34:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[20023654-6303-4d4a-953d-981078c99eb9]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG os_brick.utils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:34:34 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating existing volume attachment record: 02f66c1c-9ba6-4f26-9547-5f7f26243b88 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:34:35 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Successfully created port: c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Successfully updated port: c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquired lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-a8447156-2b93-4d15-b2c1-988ccf45636a req-3fd7ff14-9c28-48ae-8f25-2f4a1d4e2a79 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-changed-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG nova.compute.manager [req-a8447156-2b93-4d15-b2c1-988ccf45636a req-3fd7ff14-9c28-48ae-8f25-2f4a1d4e2a79 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Refreshing instance network info cache due to event network-changed-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a8447156-2b93-4d15-b2c1-988ccf45636a req-3fd7ff14-9c28-48ae-8f25-2f4a1d4e2a79 service nova] Acquiring lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating instance_info_cache with network_info: [{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Releasing lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Instance network_info: |[{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a8447156-2b93-4d15-b2c1-988ccf45636a req-3fd7ff14-9c28-48ae-8f25-2f4a1d4e2a79 service nova] Acquired lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG nova.network.neutron [req-a8447156-2b93-4d15-b2c1-988ccf45636a req-3fd7ff14-9c28-48ae-8f25-2f4a1d4e2a79 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Refreshing network info cache for port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG nova.network.neutron [req-a8447156-2b93-4d15-b2c1-988ccf45636a req-3fd7ff14-9c28-48ae-8f25-2f4a1d4e2a79 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updated VIF entry in instance network info cache for port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:34:36 user nova-compute[72426]: DEBUG nova.network.neutron [req-a8447156-2b93-4d15-b2c1-988ccf45636a req-3fd7ff14-9c28-48ae-8f25-2f4a1d4e2a79 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating instance_info_cache with network_info: [{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:34:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a8447156-2b93-4d15-b2c1-988ccf45636a req-3fd7ff14-9c28-48ae-8f25-2f4a1d4e2a79 service nova] Releasing lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:34:40 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:34:40 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:34:40 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8378MB free_disk=25.345855712890625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 81bf3e66-4c1d-46df-8756-b438aab31e1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 7cd92c00-7b80-4582-9ab1-da081b64fc41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 6fd5c82f-6b6e-48d8-a977-af76a121cd5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance ef6878eb-686c-4121-afb1-2b2dfbe2aa50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:34:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:34:42 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Creating image(s)
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Ensure instance console log exists: /opt/stack/data/nova/instances/ef6878eb-686c-4121-afb1-2b2dfbe2aa50/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Start _get_guest_xml network_info=[{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAgGVsZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef6878eb-686c-4121-afb1-2b2dfbe2aa50', 'attached_at': '', 'detached_at': '', 'volume_id': '17dd5f10-29eb-428c-afc0-fa602ea1c54b', 'serial': '17dd5f10-29eb-428c-afc0-fa602ea1c54b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '02f66c1c-9ba6-4f26-9547-5f7f26243b88', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:34:42 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:34:42 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAgGVsZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:34:42 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:34:42 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:34:42 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec16fe1-ea2e-458c-8e31-c9e6ee025fda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:34:42 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a4b597-5f94-4b50-9f84-0193604448cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b] added
Aug 01 08:34:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c78250-a1e9-4248-8062-5f9b823cbbaf]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[752e670a-a0b5-4c1a-98da-4c801f3d85db]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAgGVsZt {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAgGVsZt" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaf8e4d-cd76-4fa7-b221-c3a99b5abbeb]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KAgGVsZt'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f66bfc2-edc6-476a-b8ce-75f01dfe5060]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1a143-ee1e-4f16-86a4-8b7aa8ee330f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f354274-9eb5-4010-a9aa-3bd87b654fa2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260]
Aug 01 08:34:42 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260] successful.
Aug 01 08:34:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa0796f-02ae-439f-9630-cce9702ad0be]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b0c982-5ab3-4b47-b39c-89b95cc191dc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:42 user nova-compute[72426]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:34:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:42 user nova-compute[72426]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:34:42 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3947bf5f-4166-4c5c-81d0-230b12d07b99]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:34:42 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAgGVsZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23338343339363862', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338343339363862', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516230263',display_name='tempest-TestShelveInstance-server-1516230263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516230263',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsC56JDtGmrSrNNFqnCU+ElBlfxEp7MybjKUgi+K35GE/p1rJBrfqAQq4bZzrqcyOhsX/Ktd/e8fYCMjc1agpKUDPWyMadREtiKHCA+kqcnG2HFGBVapqbm/fOmJRu+Vg==',key_name='tempest-TestShelveInstance-1365898974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a265b55817a4ee5abb5d363e09e53b5',ramdisk_id='',reservation_id='r-z7j7mj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-787444776',owner_user_name='tempest-TestShelveInstance-787444776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:34:34Z,user_data=None,user_id='afa99527453b4d92a9737db9a6e7e51a',uuid=ef6878eb-686c-4121-afb1-2b2dfbe2aa50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converting VIF {"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lazy-loading 'pci_devices' on Instance uuid ef6878eb-686c-4121-afb1-2b2dfbe2aa50 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:34:43 user nova-compute[72426]:   <uuid>ef6878eb-686c-4121-afb1-2b2dfbe2aa50</uuid>
Aug 01 08:34:43 user nova-compute[72426]:   <name>instance-0000002f</name>
Aug 01 08:34:43 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:34:43 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:34:43 user nova-compute[72426]:   <metadata>
Aug 01 08:34:43 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:34:43 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:34:43 user nova-compute[72426]:       <nova:name>tempest-TestShelveInstance-server-1516230263</nova:name>
Aug 01 08:34:43 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:34:42</nova:creationTime>
Aug 01 08:34:43 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:34:43 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:34:43 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:34:43 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:34:43 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:34:43 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:34:43 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:34:43 user nova-compute[72426]:       <nova:owner>
Aug 01 08:34:43 user nova-compute[72426]:         <nova:user uuid="afa99527453b4d92a9737db9a6e7e51a">tempest-TestShelveInstance-787444776-project-member</nova:user>
Aug 01 08:34:43 user nova-compute[72426]:         <nova:project uuid="0a265b55817a4ee5abb5d363e09e53b5">tempest-TestShelveInstance-787444776</nova:project>
Aug 01 08:34:43 user nova-compute[72426]:       </nova:owner>
Aug 01 08:34:43 user nova-compute[72426]:       <nova:ports>
Aug 01 08:34:43 user nova-compute[72426]:         <nova:port uuid="c1a9ec2e-8c85-4851-b96b-6caae5eb4ade">
Aug 01 08:34:43 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 08:34:43 user nova-compute[72426]:         </nova:port>
Aug 01 08:34:43 user nova-compute[72426]:       </nova:ports>
Aug 01 08:34:43 user nova-compute[72426]:     </nova:instance>
Aug 01 08:34:43 user nova-compute[72426]:   </metadata>
Aug 01 08:34:43 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:34:43 user nova-compute[72426]:     <system>
Aug 01 08:34:43 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:34:43 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:34:43 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:34:43 user nova-compute[72426]:       <entry name="serial">ef6878eb-686c-4121-afb1-2b2dfbe2aa50</entry>
Aug 01 08:34:43 user nova-compute[72426]:       <entry name="uuid">ef6878eb-686c-4121-afb1-2b2dfbe2aa50</entry>
Aug 01 08:34:43 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:34:43 user nova-compute[72426]:     </system>
Aug 01 08:34:43 user nova-compute[72426]:   </sysinfo>
Aug 01 08:34:43 user nova-compute[72426]:   <os>
Aug 01 08:34:43 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:34:43 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:34:43 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:34:43 user nova-compute[72426]:   </os>
Aug 01 08:34:43 user nova-compute[72426]:   <features>
Aug 01 08:34:43 user nova-compute[72426]:     <acpi/>
Aug 01 08:34:43 user nova-compute[72426]:     <apic/>
Aug 01 08:34:43 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:34:43 user nova-compute[72426]:   </features>
Aug 01 08:34:43 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:34:43 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:34:43 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:34:43 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:34:43 user nova-compute[72426]:   </clock>
Aug 01 08:34:43 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:34:43 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:34:43 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:34:43 user nova-compute[72426]:   </cpu>
Aug 01 08:34:43 user nova-compute[72426]:   <devices>
Aug 01 08:34:43 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:34:43 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:34:43 user nova-compute[72426]:       <source dev="/dev/sdc"/>
Aug 01 08:34:43 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:34:43 user nova-compute[72426]:       <serial>17dd5f10-29eb-428c-afc0-fa602ea1c54b</serial>
Aug 01 08:34:43 user nova-compute[72426]:     </disk>
Aug 01 08:34:43 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:34:43 user nova-compute[72426]:       <mac address="fa:16:3e:46:9a:8e"/>
Aug 01 08:34:43 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:34:43 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:34:43 user nova-compute[72426]:       <target dev="tapc1a9ec2e-8c"/>
Aug 01 08:34:43 user nova-compute[72426]:     </interface>
Aug 01 08:34:43 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:34:43 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/ef6878eb-686c-4121-afb1-2b2dfbe2aa50/console.log" append="off"/>
Aug 01 08:34:43 user nova-compute[72426]:     </serial>
Aug 01 08:34:43 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:34:43 user nova-compute[72426]:     <video>
Aug 01 08:34:43 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:34:43 user nova-compute[72426]:     </video>
Aug 01 08:34:43 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:34:43 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:34:43 user nova-compute[72426]:     </rng>
Aug 01 08:34:43 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:34:43 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:34:43 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:34:43 user nova-compute[72426]:     </memballoon>
Aug 01 08:34:43 user nova-compute[72426]:   </devices>
Aug 01 08:34:43 user nova-compute[72426]: </domain>
Aug 01 08:34:43 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516230263',display_name='tempest-TestShelveInstance-server-1516230263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516230263',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsC56JDtGmrSrNNFqnCU+ElBlfxEp7MybjKUgi+K35GE/p1rJBrfqAQq4bZzrqcyOhsX/Ktd/e8fYCMjc1agpKUDPWyMadREtiKHCA+kqcnG2HFGBVapqbm/fOmJRu+Vg==',key_name='tempest-TestShelveInstance-1365898974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a265b55817a4ee5abb5d363e09e53b5',ramdisk_id='',reservation_id='r-z7j7mj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-787444776',owner_user_name='tempest-TestShelveInstance-787444776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:34:34Z,user_data=None,user_id='afa99527453b4d92a9737db9a6e7e51a',uuid=ef6878eb-686c-4121-afb1-2b2dfbe2aa50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converting VIF {"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG os_vif [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1a9ec2e-8c, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1a9ec2e-8c, col_values=(('external_ids', {'iface-id': 'c1a9ec2e-8c85-4851-b96b-6caae5eb4ade', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:9a:8e', 'vm-uuid': 'ef6878eb-686c-4121-afb1-2b2dfbe2aa50'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:43 user nova-compute[72426]: INFO os_vif [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c')
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:34:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] No VIF found with MAC fa:16:3e:46:9a:8e, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:34:44 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:34:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:34:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:34:44 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:34:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Updating instance_info_cache with network_info: [{"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-7cd92c00-7b80-4582-9ab1-da081b64fc41" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] There are 0 instances to clean {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-6174b421-6330-430f-9f5a-dd62e92d768a req-cd8aa737-eaf5-4326-9de5-f17bd79a045e service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6174b421-6330-430f-9f5a-dd62e92d768a req-cd8aa737-eaf5-4326-9de5-f17bd79a045e service nova] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6174b421-6330-430f-9f5a-dd62e92d768a req-cd8aa737-eaf5-4326-9de5-f17bd79a045e service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6174b421-6330-430f-9f5a-dd62e92d768a req-cd8aa737-eaf5-4326-9de5-f17bd79a045e service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-6174b421-6330-430f-9f5a-dd62e92d768a req-cd8aa737-eaf5-4326-9de5-f17bd79a045e service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] No waiting events found dispatching network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:34:45 user nova-compute[72426]: WARNING nova.compute.manager [req-6174b421-6330-430f-9f5a-dd62e92d768a req-cd8aa737-eaf5-4326-9de5-f17bd79a045e service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received unexpected event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade for instance with vm_state building and task_state spawning.
Aug 01 08:34:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.compute.manager [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Detaching volume a6ac3041-a6d0-4d21-99d4-cbda19793efb
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878887.2136085, ef6878eb-686c-4121-afb1-2b2dfbe2aa50 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] VM Resumed (Lifecycle Event)
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Instance spawned successfully.
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-3ab08afc-3ba3-4e71-93d7-b4d767d45394 req-240e52ec-05fe-4c8e-b9b2-b0f43ec9c4a2 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3ab08afc-3ba3-4e71-93d7-b4d767d45394 req-240e52ec-05fe-4c8e-b9b2-b0f43ec9c4a2 service nova] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3ab08afc-3ba3-4e71-93d7-b4d767d45394 req-240e52ec-05fe-4c8e-b9b2-b0f43ec9c4a2 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-3ab08afc-3ba3-4e71-93d7-b4d767d45394 req-240e52ec-05fe-4c8e-b9b2-b0f43ec9c4a2 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-3ab08afc-3ba3-4e71-93d7-b4d767d45394 req-240e52ec-05fe-4c8e-b9b2-b0f43ec9c4a2 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] No waiting events found dispatching network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:34:47 user nova-compute[72426]: WARNING nova.compute.manager [req-3ab08afc-3ba3-4e71-93d7-b4d767d45394 req-240e52ec-05fe-4c8e-b9b2-b0f43ec9c4a2 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received unexpected event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade for instance with vm_state building and task_state spawning.
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878887.2140071, ef6878eb-686c-4121-afb1-2b2dfbe2aa50 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] VM Started (Lifecycle Event)
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.virt.block_device [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Attempting to driver detach volume a6ac3041-a6d0-4d21-99d4-cbda19793efb from mountpoint /dev/vdb
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Attempting to detach device vdb from instance 7cd92c00-7b80-4582-9ab1-da081b64fc41 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:34:47 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:34:47 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:34:47 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:34:47 user nova-compute[72426]:   <serial>a6ac3041-a6d0-4d21-99d4-cbda19793efb</serial>
Aug 01 08:34:47 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:34:47 user nova-compute[72426]: </disk>
Aug 01 08:34:47 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Successfully detached device vdb from instance 7cd92c00-7b80-4582-9ab1-da081b64fc41 from the persistent domain config.
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7cd92c00-7b80-4582-9ab1-da081b64fc41 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:34:47 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:34:47 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:34:47 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:34:47 user nova-compute[72426]:   <serial>a6ac3041-a6d0-4d21-99d4-cbda19793efb</serial>
Aug 01 08:34:47 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:34:47 user nova-compute[72426]: </disk>
Aug 01 08:34:47 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.compute.manager [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Took 5.19 seconds to spawn the instance on the hypervisor.
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.compute.manager [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Took 13.62 seconds to build instance.
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ec7084d1-5f6e-46e8-b177-a316d228ddb7 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.724s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878887.8358638, 7cd92c00-7b80-4582-9ab1-da081b64fc41 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7cd92c00-7b80-4582-9ab1-da081b64fc41 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:34:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Successfully detached device vdb from instance 7cd92c00-7b80-4582-9ab1-da081b64fc41 from the live domain config.
Aug 01 08:34:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLTWgrES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:34:47 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:34:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e0eae3-b754-4ab2-9e72-5ee37c91bf12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a6ebc1-54ba-4ba5-86b7-1eae73ebc321]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:47 user nova-compute[72426]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:34:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb (non-flash)
Aug 01 08:34:47 user nova-compute[72426]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:34:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c8ba1c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f80057-2a63-490d-87dd-52a099d96040]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b45ee1-b73a-48c9-ba4d-29f0460f2570]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[653e2f30-02b2-47c0-bf83-9358909c44e6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:34:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4290e81f-720a-4505-a336-2446b1c42f27]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c2b9ed-418f-4202-abaf-a4fed8bef478]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb204034-8322-4c95-a8b3-87b961d0031b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb, portal: 172.16.0.220,3260]
Aug 01 08:34:48 user nova-compute[72426]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb, portal: 172.16.0.220,3260] successful.
Aug 01 08:34:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a630fe01-4016-4b72-9a29-de053665cf49]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] <== disconnect_volume: return (301ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG nova.objects.instance [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'flavor' on Instance uuid 7cd92c00-7b80-4582-9ab1-da081b64fc41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7885566a-0527-47a0-809f-8a8f3960fa60 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.751s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.588s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:48 user nova-compute[72426]: INFO nova.compute.manager [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Terminating instance
Aug 01 08:34:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-90530ec7-3e18-49ad-891b-3a3e6d34902a req-9d09c4a6-d2e3-4fb3-ab32-902e0614ed03 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received event network-vif-unplugged-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-90530ec7-3e18-49ad-891b-3a3e6d34902a req-9d09c4a6-d2e3-4fb3-ab32-902e0614ed03 service nova] Acquiring lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-90530ec7-3e18-49ad-891b-3a3e6d34902a req-9d09c4a6-d2e3-4fb3-ab32-902e0614ed03 service nova] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-90530ec7-3e18-49ad-891b-3a3e6d34902a req-9d09c4a6-d2e3-4fb3-ab32-902e0614ed03 service nova] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-90530ec7-3e18-49ad-891b-3a3e6d34902a req-9d09c4a6-d2e3-4fb3-ab32-902e0614ed03 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] No waiting events found dispatching network-vif-unplugged-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-90530ec7-3e18-49ad-891b-3a3e6d34902a req-9d09c4a6-d2e3-4fb3-ab32-902e0614ed03 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received event network-vif-unplugged-e8c465c8-351b-4050-b925-d21de30fbb70 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72426) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 08:34:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Instance destroyed successfully.
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.objects.instance [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'resources' on Instance uuid 7cd92c00-7b80-4582-9ab1-da081b64fc41 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:32:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1066494275',display_name='tempest-VolumesSnapshotTestJSON-instance-1066494275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1066494275',id=45,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoSRGhz95pVW6Uz/ZW/NddkB+dH5Zizy836Qyi3cuwqSiJguTt4X37KPnLJ+Ao1rcRaP3Lv12o1KrpqD4zW7jKt6zv+UICWSxQZ4KcYi6/4XbN/miPIy9NtN5ySsiCNtw==',key_name='tempest-keypair-593401585',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:32:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af75edfbd8534a9c84575464a28cdb67',ramdisk_id='',reservation_id='r-bevb8100',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-568043323',owner_user_name='tempest-VolumesSnapshotTestJSON-568043323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:32:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58361e4852e8467790067d63012c7ac1',uuid=7cd92c00-7b80-4582-9ab1-da081b64fc41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converting VIF {"id": "e8c465c8-351b-4050-b925-d21de30fbb70", "address": "fa:16:3e:3c:fe:37", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c465c8-35", "ovs_interfaceid": "e8c465c8-351b-4050-b925-d21de30fbb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:fe:37,bridge_name='br-int',has_traffic_filtering=True,id=e8c465c8-351b-4050-b925-d21de30fbb70,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c465c8-35') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_vif [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:fe:37,bridge_name='br-int',has_traffic_filtering=True,id=e8c465c8-351b-4050-b925-d21de30fbb70,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c465c8-35') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8c465c8-35, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:34:49 user nova-compute[72426]: INFO os_vif [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:fe:37,bridge_name='br-int',has_traffic_filtering=True,id=e8c465c8-351b-4050-b925-d21de30fbb70,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c465c8-35')
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aLTWgrES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:34:49 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6ac3041-a6d0-4d21-99d4-cbda19793efb', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a879bb5f-8a40-4566-983a-f4911922d2f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fcdd78-e959-4ab9-ab26-909929fa7b36]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:34:49 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:34:49 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38c020e0>, {}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Disconnecting from: [] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] <== disconnect_volume: return (48ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:34:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Deleting instance files /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41_del
Aug 01 08:34:49 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Deletion of /opt/stack/data/nova/instances/7cd92c00-7b80-4582-9ab1-da081b64fc41_del complete
Aug 01 08:34:49 user nova-compute[72426]: INFO nova.compute.manager [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 08:34:49 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:34:49 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:34:50 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:50 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:34:50 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Took 0.97 seconds to deallocate network for instance.
Aug 01 08:34:50 user nova-compute[72426]: WARNING nova.volume.cinder [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Attachment 441812d2-257a-42e0-9a2e-f4fcecc0a3b8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 441812d2-257a-42e0-9a2e-f4fcecc0a3b8. (HTTP 404) (Request-ID: req-0594dfc6-fb41-4abe-93c6-6d894cfe8158)
Aug 01 08:34:50 user nova-compute[72426]: INFO nova.compute.manager [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Took 0.03 seconds to detach 1 volumes for instance.
Aug 01 08:34:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:51 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:34:51 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:34:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:51 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Deleted allocations for instance 7cd92c00-7b80-4582-9ab1-da081b64fc41
Aug 01 08:34:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-98501891-faaa-4392-8be8-8da391cf9961 req-a6422433-9019-4b4b-a95a-47241798f494 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received event network-vif-plugged-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:34:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-98501891-faaa-4392-8be8-8da391cf9961 req-a6422433-9019-4b4b-a95a-47241798f494 service nova] Acquiring lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:34:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-98501891-faaa-4392-8be8-8da391cf9961 req-a6422433-9019-4b4b-a95a-47241798f494 service nova] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:34:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-98501891-faaa-4392-8be8-8da391cf9961 req-a6422433-9019-4b4b-a95a-47241798f494 service nova] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-98501891-faaa-4392-8be8-8da391cf9961 req-a6422433-9019-4b4b-a95a-47241798f494 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] No waiting events found dispatching network-vif-plugged-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:34:51 user nova-compute[72426]: WARNING nova.compute.manager [req-98501891-faaa-4392-8be8-8da391cf9961 req-a6422433-9019-4b4b-a95a-47241798f494 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received unexpected event network-vif-plugged-e8c465c8-351b-4050-b925-d21de30fbb70 for instance with vm_state deleted and task_state None.
Aug 01 08:34:51 user nova-compute[72426]: DEBUG nova.compute.manager [req-98501891-faaa-4392-8be8-8da391cf9961 req-a6422433-9019-4b4b-a95a-47241798f494 service nova] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Received event network-vif-deleted-e8c465c8-351b-4050-b925-d21de30fbb70 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:34:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-22d05ab3-3bef-49db-ad75-530b4713ecb2 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "7cd92c00-7b80-4582-9ab1-da081b64fc41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:34:51 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:54 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:34:55 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:34:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:34:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:34:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72426) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 08:34:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:34:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:34:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:00 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:04 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878889.718176, 7cd92c00-7b80-4582-9ab1-da081b64fc41 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:35:04 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] VM Stopped (Lifecycle Event)
Aug 01 08:35:04 user nova-compute[72426]: DEBUG nova.compute.manager [None req-9e30f748-58a7-40d8-9335-d0839a536e25 None None] [instance: 7cd92c00-7b80-4582-9ab1-da081b64fc41] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:35:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:19 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:35:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:35:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:35:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:35:25 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:35:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:35:26 user nova-compute[72426]: INFO nova.compute.manager [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attaching volume 859d5689-daf4-4b99-9f0a-318724104f46 to /dev/vdb
Aug 01 08:35:26 user nova-compute[72426]: DEBUG os_brick.utils [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[317fc313-7be1-4e64-a4ea-31bdbcb66434]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6242965-1850-4d1c-bd75-c43f57ae8166]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[83524706-9531-4c64-b5eb-1ec0e969e344]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d17be5-8844-496a-a871-4af10302a7b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:35:26 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:35:26 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6ef95a-b6e3-4295-b991-15309008dbce]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG os_brick.utils [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:35:26 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating existing volume attachment record: c176a089-135b-4113-8a09-7bf039448d16 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:35:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWxdQzPL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:35:33 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:35:33 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:35:33 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c08609-ba43-4c7d-be2c-07a0908eb4af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:35:33 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26810e0-9b5a-4b67-b525-6a74b41df55b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46] added
Aug 01 08:35:33 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a66df2-ff62-4817-b8c1-ed8a866bc679]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9ad2aa-ad30-4331-9080-922cd2809a20]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JWxdQzPL {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JWxdQzPL" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[299c6005-4632-49f2-bca9-3d51d64533fe]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JWxdQzPL'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[532fb43d-bc59-4be3-96a4-0b35fbfc3227]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74edb86-96a0-4bbb-a40e-bac8a609e9cd]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:33 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:33 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e824463c-9b71-46f7-8b3f-4f4eb0b43e39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46, portal: 172.16.0.220,3260]
Aug 01 08:35:33 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46, portal: 172.16.0.220,3260] successful.
Aug 01 08:35:33 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6294e9de-969d-40d1-b60b-9e42cbfe57b0]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[236eb4a4-cff4-4e60-8693-77e044826151]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:33 user nova-compute[72426]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 (non-flash)
Aug 01 08:35:33 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:33 user nova-compute[72426]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 (non-flash)
Aug 01 08:35:33 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee0a82f-4ce3-4d00-a63e-a1f5272fc598]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:35:33 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWxdQzPL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-63a195e4-35b2-480a-91e8-92daab041231 req-edc37843-67e8-49d8-8faa-7c740e05112f service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received event network-changed-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG nova.compute.manager [req-63a195e4-35b2-480a-91e8-92daab041231 req-edc37843-67e8-49d8-8faa-7c740e05112f service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Refreshing instance network info cache due to event network-changed-7c6e3391-ff14-484f-b749-0743a1278469. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-63a195e4-35b2-480a-91e8-92daab041231 req-edc37843-67e8-49d8-8faa-7c740e05112f service nova] Acquiring lock "refresh_cache-6fd5c82f-6b6e-48d8-a977-af76a121cd5d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-63a195e4-35b2-480a-91e8-92daab041231 req-edc37843-67e8-49d8-8faa-7c740e05112f service nova] Acquired lock "refresh_cache-6fd5c82f-6b6e-48d8-a977-af76a121cd5d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-63a195e4-35b2-480a-91e8-92daab041231 req-edc37843-67e8-49d8-8faa-7c740e05112f service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Refreshing network info cache for port 7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-63a195e4-35b2-480a-91e8-92daab041231 req-edc37843-67e8-49d8-8faa-7c740e05112f service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Updated VIF entry in instance network info cache for port 7c6e3391-ff14-484f-b749-0743a1278469. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG nova.network.neutron [req-63a195e4-35b2-480a-91e8-92daab041231 req-edc37843-67e8-49d8-8faa-7c740e05112f service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Updating instance_info_cache with network_info: [{"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26539383339633635', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539383339633635', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-63a195e4-35b2-480a-91e8-92daab041231 req-edc37843-67e8-49d8-8faa-7c740e05112f service nova] Releasing lock "refresh_cache-6fd5c82f-6b6e-48d8-a977-af76a121cd5d" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:35:34 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:35:34 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:35:34 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:35:34 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:35:34 user nova-compute[72426]:   <serial>859d5689-daf4-4b99-9f0a-318724104f46</serial>
Aug 01 08:35:34 user nova-compute[72426]: </disk>
Aug 01 08:35:34 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:35:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:35:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:35:35 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No VIF found with MAC fa:16:3e:d3:93:15, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:35:35 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cfcd513f-24f8-4d66-937e-1fda6669c3c2 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.408s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:35:37 user nova-compute[72426]: INFO nova.compute.manager [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Detaching volume 859d5689-daf4-4b99-9f0a-318724104f46
Aug 01 08:35:37 user nova-compute[72426]: INFO nova.virt.block_device [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attempting to driver detach volume 859d5689-daf4-4b99-9f0a-318724104f46 from mountpoint /dev/vdb
Aug 01 08:35:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Attempting to detach device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:35:37 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:35:37 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:35:37 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:35:37 user nova-compute[72426]:   <serial>859d5689-daf4-4b99-9f0a-318724104f46</serial>
Aug 01 08:35:37 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:35:37 user nova-compute[72426]: </disk>
Aug 01 08:35:37 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:35:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Successfully detached device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the persistent domain config.
Aug 01 08:35:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:35:37 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:35:37 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:35:37 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:35:37 user nova-compute[72426]:   <serial>859d5689-daf4-4b99-9f0a-318724104f46</serial>
Aug 01 08:35:37 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:35:37 user nova-compute[72426]: </disk>
Aug 01 08:35:37 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878937.7787523, 81bf3e66-4c1d-46df-8756-b438aab31e1e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:35:37 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Successfully detached device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the live domain config.
Aug 01 08:35:37 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWxdQzPL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:35:37 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd86f46-a146-4f06-b6b2-26d58e771114]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cbcb70-ffd4-42ad-8390-00e04ca5b827]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:37 user nova-compute[72426]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 (non-flash)
Aug 01 08:35:37 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:37 user nova-compute[72426]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 (non-flash)
Aug 01 08:35:37 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38fe09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebd4bfc-2479-44ad-a20c-230cce0a8c0b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7877d533-fdbd-4a7d-9629-37275b05e84b]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[079cd2a2-6334-49c4-ae86-071043292602]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'flavor' on Instance uuid 6fd5c82f-6b6e-48d8-a977-af76a121cd5d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fad9d3-5713-4301-9486-3d7eee866462]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9fb471-e452-4948-927e-a9532bcc866f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[565c1d26-17e4-43c8-b4ac-906f2a90c45f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46, portal: 172.16.0.220,3260]
Aug 01 08:35:38 user nova-compute[72426]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46, portal: 172.16.0.220,3260] successful.
Aug 01 08:35:38 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d5689-daf4-4b99-9f0a-318724104f46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d59a4a-4d6d-40b6-bf5a-f133344879e1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== disconnect_volume: return (293ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:35:38 user nova-compute[72426]: INFO nova.compute.manager [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Attaching volume fbb29908-25e1-4f9f-b43b-e30a29044b8c to /dev/vdb
Aug 01 08:35:38 user nova-compute[72426]: DEBUG os_brick.utils [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[56792626-92d2-4c18-a18f-0e76c2407128]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1079e433-3f0d-463e-8eb2-12fc1bb94635]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eef75f-8c3f-4d70-84d9-6381713b86f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ad1cff-48cc-48a0-8d0d-d953582ca7e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:35:38 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e2ff0e-d2e8-4cc3-82cf-ad6314ba78c4]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG os_brick.utils [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Updating existing volume attachment record: cf03b847-8ffb-40e7-843d-f5651485a5dc {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG nova.objects.instance [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7be3f93f-c1ff-4bfb-80f9-a04bcb506c48 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.816s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:35:39 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:35:39 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8379MB free_disk=25.369701385498047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 81bf3e66-4c1d-46df-8756-b438aab31e1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 6fd5c82f-6b6e-48d8-a977-af76a121cd5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance ef6878eb-686c-4121-afb1-2b2dfbe2aa50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Refreshing inventories for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Updating ProviderTree inventory for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Updating inventory in ProviderTree for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Refreshing aggregate associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, aggregates: None {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Refreshing trait associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, traits: COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 08:35:39 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:35:40 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:35:40 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:35:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:35:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:35:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:35:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:35:46 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:35:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:35:46 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:35:46 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:35:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lazy-loading 'info_cache' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:35:47 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating instance_info_cache with network_info: [{"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:35:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:35:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:35:48 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:35:48 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:35:48 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:35:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:35:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:35:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:35:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72426) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 08:35:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:35:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:35:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spcPMALn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:35:53 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:35:53 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:35:53 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cb8695-efbb-4c89-a798-67b49a1795d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:35:53 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7372bdc3-1409-4081-8740-f9ad53417943]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c] added
Aug 01 08:35:53 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[471bf293-436b-45df-8378-01ea5d890c6e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee82980-5d03-43ad-a2c2-a4917a24b7a9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spcPMALn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v spcPMALn" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3365f0-007c-406a-a944-566004055f29]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'spcPMALn'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[426d1f58-0719-43b1-ba0d-90b4f4be8f95]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:53 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d066332-13a9-4d57-ae08-860cfc75cfd4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc7392a-ba61-4b24-ab5b-5605a6d4db2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c, portal: 172.16.0.220,3260]
Aug 01 08:35:54 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c, portal: 172.16.0.220,3260] successful.
Aug 01 08:35:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f390ac-7227-427c-93a9-e8f7d12d7c42]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7cf1a2-09c4-4d1b-9303-30a82880b128]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:54 user nova-compute[72426]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c (non-flash)
Aug 01 08:35:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:54 user nova-compute[72426]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c (non-flash)
Aug 01 08:35:54 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b987b75b-01d6-4465-8354-8909150faafd]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spcPMALn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:35:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:35:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:35:55 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23639393338393637', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:35:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639393338393637', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:35:55 user nova-compute[72426]: DEBUG nova.objects.instance [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'flavor' on Instance uuid 6fd5c82f-6b6e-48d8-a977-af76a121cd5d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:35:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:35:55 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:35:55 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:35:55 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:35:55 user nova-compute[72426]:   <serial>fbb29908-25e1-4f9f-b43b-e30a29044b8c</serial>
Aug 01 08:35:55 user nova-compute[72426]: </disk>
Aug 01 08:35:55 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:35:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:35:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:35:55 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No VIF found with MAC fa:16:3e:7a:00:4f, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:35:55 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-2139be6e-9d57-4388-9897-cbf535e9bc66 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.629s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:35:56 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:35:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:35:56 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:35:56 user nova-compute[72426]: INFO nova.compute.manager [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Detaching volume fbb29908-25e1-4f9f-b43b-e30a29044b8c
Aug 01 08:35:56 user nova-compute[72426]: INFO nova.virt.block_device [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Attempting to driver detach volume fbb29908-25e1-4f9f-b43b-e30a29044b8c from mountpoint /dev/vdb
Aug 01 08:35:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Attempting to detach device vdb from instance 6fd5c82f-6b6e-48d8-a977-af76a121cd5d from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:35:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:35:56 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:35:56 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:35:56 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:35:56 user nova-compute[72426]:   <serial>fbb29908-25e1-4f9f-b43b-e30a29044b8c</serial>
Aug 01 08:35:56 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:35:56 user nova-compute[72426]: </disk>
Aug 01 08:35:56 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:35:56 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully detached device vdb from instance 6fd5c82f-6b6e-48d8-a977-af76a121cd5d from the persistent domain config.
Aug 01 08:35:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fd5c82f-6b6e-48d8-a977-af76a121cd5d from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:35:56 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:35:56 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:35:56 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:35:56 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:35:56 user nova-compute[72426]:   <serial>fbb29908-25e1-4f9f-b43b-e30a29044b8c</serial>
Aug 01 08:35:56 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:35:56 user nova-compute[72426]: </disk>
Aug 01 08:35:56 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690878957.3270097, 6fd5c82f-6b6e-48d8-a977-af76a121cd5d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fd5c82f-6b6e-48d8-a977-af76a121cd5d {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:35:57 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully detached device vdb from instance 6fd5c82f-6b6e-48d8-a977-af76a121cd5d from the live domain config.
Aug 01 08:35:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'spcPMALn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:35:57 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8114ef46-08a8-436a-bf80-c3e149e1c29a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cd721d-70e0-43ac-837e-232ace7acff4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:57 user nova-compute[72426]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c (non-flash)
Aug 01 08:35:57 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:35:57 user nova-compute[72426]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c (non-flash)
Aug 01 08:35:57 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c8b8bb6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2fc7f8-5ee1-45ed-8b51-4f2989250414]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dbd275-34cc-44de-a5fb-c09d93df9204]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1617e1a3-78cf-4b12-9ee2-9a611e09d053]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eeab6e2-a659-42ad-97ef-bf7ba4345a0f]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a696bcf4-6bd0-4e75-a009-63cd5ceb0cb3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c0eb82-c473-4ba5-99bb-96bd5e03b0e8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c, portal: 172.16.0.220,3260]
Aug 01 08:35:57 user nova-compute[72426]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c, portal: 172.16.0.220,3260] successful.
Aug 01 08:35:57 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb29908-25e1-4f9f-b43b-e30a29044b8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e4955a-ca15-4e4c-948a-dc97118100d9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] <== disconnect_volume: return (293ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:35:57 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:35:58 user nova-compute[72426]: DEBUG nova.objects.instance [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'flavor' on Instance uuid 6fd5c82f-6b6e-48d8-a977-af76a121cd5d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:35:58 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-d641cb40-fae5-4e03-a2c4-7209e37d45d0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.662s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:35:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG nova.compute.manager [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:36:02 user nova-compute[72426]: INFO nova.compute.claims [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Claim successful on node user
Aug 01 08:36:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG nova.compute.manager [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG nova.compute.manager [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:36:02 user nova-compute[72426]: DEBUG nova.network.neutron [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:36:02 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:36:02 user nova-compute[72426]: DEBUG nova.compute.manager [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG nova.policy [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58361e4852e8467790067d63012c7ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af75edfbd8534a9c84575464a28cdb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG nova.compute.manager [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:36:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Creating image(s)
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "/opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "/opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk 1073741824" returned: 0 in 0.051s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.139s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG nova.network.neutron [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Successfully created port: 14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Cannot resize image /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG nova.objects.instance [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'migration_context' on Instance uuid fb9c5fe4-05a8-4a04-92b9-eef36b32f777 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Ensure instance console log exists: /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.network.neutron [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Successfully updated port: 14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "refresh_cache-fb9c5fe4-05a8-4a04-92b9-eef36b32f777" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquired lock "refresh_cache-fb9c5fe4-05a8-4a04-92b9-eef36b32f777" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.network.neutron [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-4c15fe89-6d98-43d1-81d9-64115c5f5047 req-ae32e6c9-71a3-443f-bbc7-67107a4379b1 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received event network-changed-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-4c15fe89-6d98-43d1-81d9-64115c5f5047 req-ae32e6c9-71a3-443f-bbc7-67107a4379b1 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Refreshing instance network info cache due to event network-changed-14bbb71b-466c-483f-b903-3d862c466b46. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4c15fe89-6d98-43d1-81d9-64115c5f5047 req-ae32e6c9-71a3-443f-bbc7-67107a4379b1 service nova] Acquiring lock "refresh_cache-fb9c5fe4-05a8-4a04-92b9-eef36b32f777" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.network.neutron [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.network.neutron [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Updating instance_info_cache with network_info: [{"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Releasing lock "refresh_cache-fb9c5fe4-05a8-4a04-92b9-eef36b32f777" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.compute.manager [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Instance network_info: |[{"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4c15fe89-6d98-43d1-81d9-64115c5f5047 req-ae32e6c9-71a3-443f-bbc7-67107a4379b1 service nova] Acquired lock "refresh_cache-fb9c5fe4-05a8-4a04-92b9-eef36b32f777" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.network.neutron [req-4c15fe89-6d98-43d1-81d9-64115c5f5047 req-ae32e6c9-71a3-443f-bbc7-67107a4379b1 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Refreshing network info cache for port 14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Start _get_guest_xml network_info=[{"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:36:04 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:36:04 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-75632591',display_name='tempest-VolumesSnapshotTestJSON-instance-75632591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-75632591',id=48,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7gue+vba+SAqJb3PECo4qz55ukMJHrRGc3C7N/NLfZrs62bPddRxVssD8BZquEuRrLjxyGweNH3VwEZLR2DKWSsofs31wANXElFXW2QNJseT2IifW/brC7NDzsHLpVOQ==',key_name='tempest-keypair-272780877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af75edfbd8534a9c84575464a28cdb67',ramdisk_id='',reservation_id='r-rgkv823j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-568043323',owner_user_name='tempest-VolumesSnapshotTestJSON-568043323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58361e4852e8467790067d63012c7ac1',uuid=fb9c5fe4-05a8-4a04-92b9-eef36b32f777,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converting VIF {"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:94:3a,bridge_name='br-int',has_traffic_filtering=True,id=14bbb71b-466c-483f-b903-3d862c466b46,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14bbb71b-46') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.objects.instance [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'pci_devices' on Instance uuid fb9c5fe4-05a8-4a04-92b9-eef36b32f777 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:36:04 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:36:04 user nova-compute[72426]:   <uuid>fb9c5fe4-05a8-4a04-92b9-eef36b32f777</uuid>
Aug 01 08:36:04 user nova-compute[72426]:   <name>instance-00000030</name>
Aug 01 08:36:04 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:36:04 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:36:04 user nova-compute[72426]:   <metadata>
Aug 01 08:36:04 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:36:04 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:36:04 user nova-compute[72426]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-75632591</nova:name>
Aug 01 08:36:04 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:36:04</nova:creationTime>
Aug 01 08:36:04 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:36:04 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:36:04 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:36:04 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:36:04 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:36:04 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:36:04 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:36:04 user nova-compute[72426]:       <nova:owner>
Aug 01 08:36:04 user nova-compute[72426]:         <nova:user uuid="58361e4852e8467790067d63012c7ac1">tempest-VolumesSnapshotTestJSON-568043323-project-member</nova:user>
Aug 01 08:36:04 user nova-compute[72426]:         <nova:project uuid="af75edfbd8534a9c84575464a28cdb67">tempest-VolumesSnapshotTestJSON-568043323</nova:project>
Aug 01 08:36:04 user nova-compute[72426]:       </nova:owner>
Aug 01 08:36:04 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:36:04 user nova-compute[72426]:       <nova:ports>
Aug 01 08:36:04 user nova-compute[72426]:         <nova:port uuid="14bbb71b-466c-483f-b903-3d862c466b46">
Aug 01 08:36:04 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 08:36:04 user nova-compute[72426]:         </nova:port>
Aug 01 08:36:04 user nova-compute[72426]:       </nova:ports>
Aug 01 08:36:04 user nova-compute[72426]:     </nova:instance>
Aug 01 08:36:04 user nova-compute[72426]:   </metadata>
Aug 01 08:36:04 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:36:04 user nova-compute[72426]:     <system>
Aug 01 08:36:04 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:36:04 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:36:04 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:36:04 user nova-compute[72426]:       <entry name="serial">fb9c5fe4-05a8-4a04-92b9-eef36b32f777</entry>
Aug 01 08:36:04 user nova-compute[72426]:       <entry name="uuid">fb9c5fe4-05a8-4a04-92b9-eef36b32f777</entry>
Aug 01 08:36:04 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:36:04 user nova-compute[72426]:     </system>
Aug 01 08:36:04 user nova-compute[72426]:   </sysinfo>
Aug 01 08:36:04 user nova-compute[72426]:   <os>
Aug 01 08:36:04 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:36:04 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:36:04 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:36:04 user nova-compute[72426]:   </os>
Aug 01 08:36:04 user nova-compute[72426]:   <features>
Aug 01 08:36:04 user nova-compute[72426]:     <acpi/>
Aug 01 08:36:04 user nova-compute[72426]:     <apic/>
Aug 01 08:36:04 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:36:04 user nova-compute[72426]:   </features>
Aug 01 08:36:04 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:36:04 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:36:04 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:36:04 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:36:04 user nova-compute[72426]:   </clock>
Aug 01 08:36:04 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:36:04 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:36:04 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:36:04 user nova-compute[72426]:   </cpu>
Aug 01 08:36:04 user nova-compute[72426]:   <devices>
Aug 01 08:36:04 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:36:04 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:36:04 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk"/>
Aug 01 08:36:04 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:36:04 user nova-compute[72426]:     </disk>
Aug 01 08:36:04 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:36:04 user nova-compute[72426]:       <mac address="fa:16:3e:67:94:3a"/>
Aug 01 08:36:04 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:36:04 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:36:04 user nova-compute[72426]:       <target dev="tap14bbb71b-46"/>
Aug 01 08:36:04 user nova-compute[72426]:     </interface>
Aug 01 08:36:04 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:36:04 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/console.log" append="off"/>
Aug 01 08:36:04 user nova-compute[72426]:     </serial>
Aug 01 08:36:04 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:36:04 user nova-compute[72426]:     <video>
Aug 01 08:36:04 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:36:04 user nova-compute[72426]:     </video>
Aug 01 08:36:04 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:36:04 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:36:04 user nova-compute[72426]:     </rng>
Aug 01 08:36:04 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:36:04 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:36:04 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:36:04 user nova-compute[72426]:     </memballoon>
Aug 01 08:36:04 user nova-compute[72426]:   </devices>
Aug 01 08:36:04 user nova-compute[72426]: </domain>
Aug 01 08:36:04 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-75632591',display_name='tempest-VolumesSnapshotTestJSON-instance-75632591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-75632591',id=48,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7gue+vba+SAqJb3PECo4qz55ukMJHrRGc3C7N/NLfZrs62bPddRxVssD8BZquEuRrLjxyGweNH3VwEZLR2DKWSsofs31wANXElFXW2QNJseT2IifW/brC7NDzsHLpVOQ==',key_name='tempest-keypair-272780877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af75edfbd8534a9c84575464a28cdb67',ramdisk_id='',reservation_id='r-rgkv823j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-568043323',owner_user_name='tempest-VolumesSnapshotTestJSON-568043323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58361e4852e8467790067d63012c7ac1',uuid=fb9c5fe4-05a8-4a04-92b9-eef36b32f777,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converting VIF {"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:94:3a,bridge_name='br-int',has_traffic_filtering=True,id=14bbb71b-466c-483f-b903-3d862c466b46,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14bbb71b-46') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG os_vif [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:94:3a,bridge_name='br-int',has_traffic_filtering=True,id=14bbb71b-466c-483f-b903-3d862c466b46,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14bbb71b-46') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14bbb71b-46, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14bbb71b-46, col_values=(('external_ids', {'iface-id': '14bbb71b-466c-483f-b903-3d862c466b46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:94:3a', 'vm-uuid': 'fb9c5fe4-05a8-4a04-92b9-eef36b32f777'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:05 user nova-compute[72426]: INFO os_vif [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:94:3a,bridge_name='br-int',has_traffic_filtering=True,id=14bbb71b-466c-483f-b903-3d862c466b46,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14bbb71b-46')
Aug 01 08:36:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] No VIF found with MAC fa:16:3e:67:94:3a, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG nova.network.neutron [req-4c15fe89-6d98-43d1-81d9-64115c5f5047 req-ae32e6c9-71a3-443f-bbc7-67107a4379b1 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Updated VIF entry in instance network info cache for port 14bbb71b-466c-483f-b903-3d862c466b46. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG nova.network.neutron [req-4c15fe89-6d98-43d1-81d9-64115c5f5047 req-ae32e6c9-71a3-443f-bbc7-67107a4379b1 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Updating instance_info_cache with network_info: [{"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:36:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4c15fe89-6d98-43d1-81d9-64115c5f5047 req-ae32e6c9-71a3-443f-bbc7-67107a4379b1 service nova] Releasing lock "refresh_cache-fb9c5fe4-05a8-4a04-92b9-eef36b32f777" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:36:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-26dd02ca-a87e-4947-83ce-fda59fa1909f req-75647206-4bd0-4f60-a8b2-c1dd93585351 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received event network-vif-plugged-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-26dd02ca-a87e-4947-83ce-fda59fa1909f req-75647206-4bd0-4f60-a8b2-c1dd93585351 service nova] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-26dd02ca-a87e-4947-83ce-fda59fa1909f req-75647206-4bd0-4f60-a8b2-c1dd93585351 service nova] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:06 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-26dd02ca-a87e-4947-83ce-fda59fa1909f req-75647206-4bd0-4f60-a8b2-c1dd93585351 service nova] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:06 user nova-compute[72426]: DEBUG nova.compute.manager [req-26dd02ca-a87e-4947-83ce-fda59fa1909f req-75647206-4bd0-4f60-a8b2-c1dd93585351 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] No waiting events found dispatching network-vif-plugged-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:36:06 user nova-compute[72426]: WARNING nova.compute.manager [req-26dd02ca-a87e-4947-83ce-fda59fa1909f req-75647206-4bd0-4f60-a8b2-c1dd93585351 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received unexpected event network-vif-plugged-14bbb71b-466c-483f-b903-3d862c466b46 for instance with vm_state building and task_state spawning.
Aug 01 08:36:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid 6fd5c82f-6b6e-48d8-a977-af76a121cd5d {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid ef6878eb-686c-4121-afb1-2b2dfbe2aa50 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Triggering sync for uuid fb9c5fe4-05a8-4a04-92b9-eef36b32f777 {{(pid=72426) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:07 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878968.6995873, fb9c5fe4-05a8-4a04-92b9-eef36b32f777 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:36:08 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] VM Resumed (Lifecycle Event)
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:36:08 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Instance spawned successfully.
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:08 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690878968.7012134, fb9c5fe4-05a8-4a04-92b9-eef36b32f777 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:36:08 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] VM Started (Lifecycle Event)
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:36:08 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-1bc07be5-817d-4889-9f34-84db8e45433f req-cc01ee21-63a6-42f9-9fa3-5702aac3bffb service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received event network-vif-plugged-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1bc07be5-817d-4889-9f34-84db8e45433f req-cc01ee21-63a6-42f9-9fa3-5702aac3bffb service nova] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1bc07be5-817d-4889-9f34-84db8e45433f req-cc01ee21-63a6-42f9-9fa3-5702aac3bffb service nova] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1bc07be5-817d-4889-9f34-84db8e45433f req-cc01ee21-63a6-42f9-9fa3-5702aac3bffb service nova] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-1bc07be5-817d-4889-9f34-84db8e45433f req-cc01ee21-63a6-42f9-9fa3-5702aac3bffb service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] No waiting events found dispatching network-vif-plugged-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:36:08 user nova-compute[72426]: WARNING nova.compute.manager [req-1bc07be5-817d-4889-9f34-84db8e45433f req-cc01ee21-63a6-42f9-9fa3-5702aac3bffb service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received unexpected event network-vif-plugged-14bbb71b-466c-483f-b903-3d862c466b46 for instance with vm_state building and task_state spawning.
Aug 01 08:36:08 user nova-compute[72426]: INFO nova.compute.manager [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 01 08:36:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:36:08 user nova-compute[72426]: INFO nova.compute.manager [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Took 6.42 seconds to build instance.
Aug 01 08:36:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-dfea07bb-df5a-4a15-b8f4-def26003a96b tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.522s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.216s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:08 user nova-compute[72426]: INFO nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:36:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:15 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:20 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-7b8d28a0-8455-4742-92cd-29dbb1673cf3 req-ce857d2a-27cc-4a9d-bfc2-bbf2fb188765 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-changed-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-7b8d28a0-8455-4742-92cd-29dbb1673cf3 req-ce857d2a-27cc-4a9d-bfc2-bbf2fb188765 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Refreshing instance network info cache due to event network-changed-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:36:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7b8d28a0-8455-4742-92cd-29dbb1673cf3 req-ce857d2a-27cc-4a9d-bfc2-bbf2fb188765 service nova] Acquiring lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:36:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7b8d28a0-8455-4742-92cd-29dbb1673cf3 req-ce857d2a-27cc-4a9d-bfc2-bbf2fb188765 service nova] Acquired lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:36:25 user nova-compute[72426]: DEBUG nova.network.neutron [req-7b8d28a0-8455-4742-92cd-29dbb1673cf3 req-ce857d2a-27cc-4a9d-bfc2-bbf2fb188765 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Refreshing network info cache for port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:26 user nova-compute[72426]: INFO nova.compute.manager [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Shelve offloading
Aug 01 08:36:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG nova.network.neutron [req-7b8d28a0-8455-4742-92cd-29dbb1673cf3 req-ce857d2a-27cc-4a9d-bfc2-bbf2fb188765 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updated VIF entry in instance network info cache for port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG nova.network.neutron [req-7b8d28a0-8455-4742-92cd-29dbb1673cf3 req-ce857d2a-27cc-4a9d-bfc2-bbf2fb188765 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating instance_info_cache with network_info: [{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-7b8d28a0-8455-4742-92cd-29dbb1673cf3 req-ce857d2a-27cc-4a9d-bfc2-bbf2fb188765 service nova] Releasing lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-43857c80-4df9-493a-959d-8a7b89e97357 req-d550e167-e63f-4d3a-bb40-3a8e5eecdc1c service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-vif-unplugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-43857c80-4df9-493a-959d-8a7b89e97357 req-d550e167-e63f-4d3a-bb40-3a8e5eecdc1c service nova] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-43857c80-4df9-493a-959d-8a7b89e97357 req-d550e167-e63f-4d3a-bb40-3a8e5eecdc1c service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-43857c80-4df9-493a-959d-8a7b89e97357 req-d550e167-e63f-4d3a-bb40-3a8e5eecdc1c service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG nova.compute.manager [req-43857c80-4df9-493a-959d-8a7b89e97357 req-d550e167-e63f-4d3a-bb40-3a8e5eecdc1c service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] No waiting events found dispatching network-vif-unplugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:36:26 user nova-compute[72426]: WARNING nova.compute.manager [req-43857c80-4df9-493a-959d-8a7b89e97357 req-d550e167-e63f-4d3a-bb40-3a8e5eecdc1c service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received unexpected event network-vif-unplugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade for instance with vm_state active and task_state shelving.
Aug 01 08:36:26 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Instance destroyed successfully.
Aug 01 08:36:26 user nova-compute[72426]: DEBUG nova.compute.manager [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquired lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:36:26 user nova-compute[72426]: DEBUG nova.network.neutron [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:36:27 user nova-compute[72426]: DEBUG nova.network.neutron [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating instance_info_cache with network_info: [{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:36:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Releasing lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:36:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-83faf8be-58e8-4380-a6a2-a8e8066f20c3 req-757a865e-63f5-492f-a5dd-f6764bb438e8 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-83faf8be-58e8-4380-a6a2-a8e8066f20c3 req-757a865e-63f5-492f-a5dd-f6764bb438e8 service nova] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-83faf8be-58e8-4380-a6a2-a8e8066f20c3 req-757a865e-63f5-492f-a5dd-f6764bb438e8 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-83faf8be-58e8-4380-a6a2-a8e8066f20c3 req-757a865e-63f5-492f-a5dd-f6764bb438e8 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:28 user nova-compute[72426]: DEBUG nova.compute.manager [req-83faf8be-58e8-4380-a6a2-a8e8066f20c3 req-757a865e-63f5-492f-a5dd-f6764bb438e8 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] No waiting events found dispatching network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:36:28 user nova-compute[72426]: WARNING nova.compute.manager [req-83faf8be-58e8-4380-a6a2-a8e8066f20c3 req-757a865e-63f5-492f-a5dd-f6764bb438e8 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received unexpected event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade for instance with vm_state active and task_state shelving.
Aug 01 08:36:29 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Instance destroyed successfully.
Aug 01 08:36:29 user nova-compute[72426]: DEBUG nova.objects.instance [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lazy-loading 'resources' on Instance uuid ef6878eb-686c-4121-afb1-2b2dfbe2aa50 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516230263',display_name='tempest-TestShelveInstance-server-1516230263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516230263',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsC56JDtGmrSrNNFqnCU+ElBlfxEp7MybjKUgi+K35GE/p1rJBrfqAQq4bZzrqcyOhsX/Ktd/e8fYCMjc1agpKUDPWyMadREtiKHCA+kqcnG2HFGBVapqbm/fOmJRu+Vg==',key_name='tempest-TestShelveInstance-1365898974',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a265b55817a4ee5abb5d363e09e53b5',ramdisk_id='',reservation_id='r-z7j7mj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-787444776',owner_user_name='tempest-TestShelveInstance-787444776-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:34:47Z,user_data=None,user_id='afa99527453b4d92a9737db9a6e7e51a',uuid=ef6878eb-686c-4121-afb1-2b2dfbe2aa50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converting VIF {"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_vif [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1a9ec2e-8c, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-fdcee2cb-75df-4d80-b07a-3bab4f262b9d req-b8253d68-e183-4e96-acef-3a04231744e1 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-changed-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-fdcee2cb-75df-4d80-b07a-3bab4f262b9d req-b8253d68-e183-4e96-acef-3a04231744e1 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Refreshing instance network info cache due to event network-changed-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fdcee2cb-75df-4d80-b07a-3bab4f262b9d req-b8253d68-e183-4e96-acef-3a04231744e1 service nova] Acquiring lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fdcee2cb-75df-4d80-b07a-3bab4f262b9d req-b8253d68-e183-4e96-acef-3a04231744e1 service nova] Acquired lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG nova.network.neutron [req-fdcee2cb-75df-4d80-b07a-3bab4f262b9d req-b8253d68-e183-4e96-acef-3a04231744e1 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Refreshing network info cache for port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:36:29 user nova-compute[72426]: INFO os_vif [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c')
Aug 01 08:36:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAgGVsZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:36:29 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67f94e9-5322-4c63-ba4c-a7ba0cc44d4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb428a04-b068-4aa9-8ca1-99f844ffaceb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:36:29 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:36:29 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c389fdab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[429259cc-85b0-4dbf-8e49-1d7dda81e561]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b31aa2-5067-48c4-a342-a815afaee7c5]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae0748e-9824-435a-a01a-0edeef322155]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff45ffed-8300-4147-ab36-a0400bc0d41f]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe67db6-404b-4b16-b39f-07058238e6e2]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcff72e0-ab72-4218-853b-d4a63d71ba34]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260]
Aug 01 08:36:29 user nova-compute[72426]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260] successful.
Aug 01 08:36:29 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffc109c-5008-4473-9b95-607232fc72cf]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] <== disconnect_volume: return (264ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:36:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:36:29 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Deleting instance files /opt/stack/data/nova/instances/ef6878eb-686c-4121-afb1-2b2dfbe2aa50_del
Aug 01 08:36:29 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Deletion of /opt/stack/data/nova/instances/ef6878eb-686c-4121-afb1-2b2dfbe2aa50_del complete
Aug 01 08:36:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:30 user nova-compute[72426]: DEBUG nova.network.neutron [req-fdcee2cb-75df-4d80-b07a-3bab4f262b9d req-b8253d68-e183-4e96-acef-3a04231744e1 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updated VIF entry in instance network info cache for port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:36:30 user nova-compute[72426]: DEBUG nova.network.neutron [req-fdcee2cb-75df-4d80-b07a-3bab4f262b9d req-b8253d68-e183-4e96-acef-3a04231744e1 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating instance_info_cache with network_info: [{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": null, "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:36:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-fdcee2cb-75df-4d80-b07a-3bab4f262b9d req-b8253d68-e183-4e96-acef-3a04231744e1 service nova] Releasing lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:36:30 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Deleted allocations for instance ef6878eb-686c-4121-afb1-2b2dfbe2aa50
Aug 01 08:36:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:30 user nova-compute[72426]: DEBUG nova.objects.instance [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lazy-loading 'numa_topology' on Instance uuid ef6878eb-686c-4121-afb1-2b2dfbe2aa50 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:36:30 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:36:30 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:36:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-398c51a2-c295-4f38-9e6a-e3189882801e tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.661s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG nova.objects.instance [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:31 user nova-compute[72426]: INFO nova.compute.manager [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attaching volume 602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 to /dev/vdb
Aug 01 08:36:31 user nova-compute[72426]: DEBUG os_brick.utils [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37d24b3-aa51-477f-984e-7f97409668ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b702c325-6fde-48b9-91f7-a91f4aed4d5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6925e2-bb8b-4157-a30f-4b3b082cc693]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e42a632-bea9-431c-9d56-e669c165bed4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:36:31 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:36:31 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2041fff-85e4-4615-ba31-1e25ade61e30]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG os_brick.utils [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:36:31 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating existing volume attachment record: 94e5b7c0-1793-4b29-a252-4ee7c9669db7 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:36:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:36 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWKnfigE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:36:38 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:36:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:36:38 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:36:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:36:38 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c021d92-afb5-4440-b7af-57eabd0e7ce8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:36:38 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd2e93d-9b79-41b8-a38d-0c3469077b62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9] added
Aug 01 08:36:38 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d83a14-1a43-4c2a-87d7-66463df87d54]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff9d06e-48cc-4c01-844c-239ca33f9050]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWKnfigE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWKnfigE" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd37e5-d111-405c-ba25-663a20166fa6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XWKnfigE'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:38 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca85b43-514a-45b8-8f8f-8099da666574]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[060298d7-b5bb-4f35-86dc-123db4a0eed5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:36:39 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:36:39 user nova-compute[72426]:  {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:36:39 user nova-compute[72426]: WARNING os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 08:36:39 user nova-compute[72426]: 
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e1ba39-69eb-40b3-9c72-bb36bf46f533]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9, portal: 172.16.0.220,3260]
Aug 01 08:36:39 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9, portal: 172.16.0.220,3260] successful.
Aug 01 08:36:39 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4fc9c4-8071-4df6-90ff-10e27f4d1172]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acaac8e-e2cc-4bee-b448-1cb12ff86aa9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 (non-flash)
Aug 01 08:36:39 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 (non-flash)
Aug 01 08:36:39 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ab7b07-0881-4108-9555-83eefa79476f]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWKnfigE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:36:39 user nova-compute[72426]: INFO nova.compute.claims [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Claim successful on node user
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.085s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:36:39 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.policy [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c36f2803e634f008de831a9c38cb1c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a34680570c864d7aa0ff5269d0d73434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:36:39 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Creating image(s)
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "/opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "/opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "/opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:39 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk 1073741824" returned: 0 in 0.088s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23132303432343166', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132303432343166', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG nova.objects.instance [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:36:40 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:36:40 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:36:40 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:36:40 user nova-compute[72426]:   <serial>602d0edf-6d2a-4e92-8c04-b4172f1cc5a9</serial>
Aug 01 08:36:40 user nova-compute[72426]: </disk>
Aug 01 08:36:40 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Successfully created port: 2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Cannot resize image /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lazy-loading 'migration_context' on Instance uuid 262464cd-ee17-433f-ac64-c6250c61af25 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Ensure instance console log exists: /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:41 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:36:41 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8267MB free_disk=25.327831268310547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] No VIF found with MAC fa:16:3e:d3:93:15, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 81bf3e66-4c1d-46df-8756-b438aab31e1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 6fd5c82f-6b6e-48d8-a977-af76a121cd5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance fb9c5fe4-05a8-4a04-92b9-eef36b32f777 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 262464cd-ee17-433f-ac64-c6250c61af25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-9efb5db3-869c-4be0-8e9d-0a3a423f170e tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.562s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Successfully updated port: 2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquired lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.manager [req-53b01d12-e285-4ab6-9ff6-a700b157a245 req-71bc9e64-23bd-4d5a-8527-ceafd657f4e5 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-changed-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.manager [req-53b01d12-e285-4ab6-9ff6-a700b157a245 req-71bc9e64-23bd-4d5a-8527-ceafd657f4e5 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Refreshing instance network info cache due to event network-changed-2341ac13-4d4d-40d6-9603-bd5277c46280. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-53b01d12-e285-4ab6-9ff6-a700b157a245 req-71bc9e64-23bd-4d5a-8527-ceafd657f4e5 service nova] Acquiring lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.network.neutron [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Updating instance_info_cache with network_info: [{"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Releasing lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Instance network_info: |[{"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-53b01d12-e285-4ab6-9ff6-a700b157a245 req-71bc9e64-23bd-4d5a-8527-ceafd657f4e5 service nova] Acquired lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.network.neutron [req-53b01d12-e285-4ab6-9ff6-a700b157a245 req-71bc9e64-23bd-4d5a-8527-ceafd657f4e5 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Refreshing network info cache for port 2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Start _get_guest_xml network_info=[{"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:36:41 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:36:41 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-201315796',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-201315796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2013157',id=49,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa/9a1G8HLWt4G3Cy8dhrQSlyxAHvMAYyYmeIkbe9H8CoJcxSnmVjXcwLGZfE7FLHLE7lTPCVoITdVeLP9em0p49Gk0O6Oiig+uIeCUn1FrSuajFCvYxPtg8KnTO9lDFw==',key_name='tempest-keypair-1734785821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a34680570c864d7aa0ff5269d0d73434',ramdisk_id='',reservation_id='r-wao90jaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2119158265',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c36f2803e634f008de831a9c38cb1c3',uuid=262464cd-ee17-433f-ac64-c6250c61af25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Converting VIF {"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=2341ac13-4d4d-40d6-9603-bd5277c46280,network=Network(fbfc064a-eaec-43c8-98f7-90d696ab641e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2341ac13-4d') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.objects.instance [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lazy-loading 'pci_devices' on Instance uuid 262464cd-ee17-433f-ac64-c6250c61af25 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:36:41 user nova-compute[72426]:   <uuid>262464cd-ee17-433f-ac64-c6250c61af25</uuid>
Aug 01 08:36:41 user nova-compute[72426]:   <name>instance-00000031</name>
Aug 01 08:36:41 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:36:41 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:36:41 user nova-compute[72426]:   <metadata>
Aug 01 08:36:41 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:36:41 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:36:41 user nova-compute[72426]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-201315796</nova:name>
Aug 01 08:36:41 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:36:41</nova:creationTime>
Aug 01 08:36:41 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:36:41 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:36:41 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:36:41 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:36:41 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:36:41 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:36:41 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:36:41 user nova-compute[72426]:       <nova:owner>
Aug 01 08:36:41 user nova-compute[72426]:         <nova:user uuid="4c36f2803e634f008de831a9c38cb1c3">tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member</nova:user>
Aug 01 08:36:41 user nova-compute[72426]:         <nova:project uuid="a34680570c864d7aa0ff5269d0d73434">tempest-TestServerVolumeAttachScenarioOldVersion-2119158265</nova:project>
Aug 01 08:36:41 user nova-compute[72426]:       </nova:owner>
Aug 01 08:36:41 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:36:41 user nova-compute[72426]:       <nova:ports>
Aug 01 08:36:41 user nova-compute[72426]:         <nova:port uuid="2341ac13-4d4d-40d6-9603-bd5277c46280">
Aug 01 08:36:41 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 08:36:41 user nova-compute[72426]:         </nova:port>
Aug 01 08:36:41 user nova-compute[72426]:       </nova:ports>
Aug 01 08:36:41 user nova-compute[72426]:     </nova:instance>
Aug 01 08:36:41 user nova-compute[72426]:   </metadata>
Aug 01 08:36:41 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:36:41 user nova-compute[72426]:     <system>
Aug 01 08:36:41 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:36:41 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:36:41 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:36:41 user nova-compute[72426]:       <entry name="serial">262464cd-ee17-433f-ac64-c6250c61af25</entry>
Aug 01 08:36:41 user nova-compute[72426]:       <entry name="uuid">262464cd-ee17-433f-ac64-c6250c61af25</entry>
Aug 01 08:36:41 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:36:41 user nova-compute[72426]:     </system>
Aug 01 08:36:41 user nova-compute[72426]:   </sysinfo>
Aug 01 08:36:41 user nova-compute[72426]:   <os>
Aug 01 08:36:41 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:36:41 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:36:41 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:36:41 user nova-compute[72426]:   </os>
Aug 01 08:36:41 user nova-compute[72426]:   <features>
Aug 01 08:36:41 user nova-compute[72426]:     <acpi/>
Aug 01 08:36:41 user nova-compute[72426]:     <apic/>
Aug 01 08:36:41 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:36:41 user nova-compute[72426]:   </features>
Aug 01 08:36:41 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:36:41 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:36:41 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:36:41 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:36:41 user nova-compute[72426]:   </clock>
Aug 01 08:36:41 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:36:41 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:36:41 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:36:41 user nova-compute[72426]:   </cpu>
Aug 01 08:36:41 user nova-compute[72426]:   <devices>
Aug 01 08:36:41 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:36:41 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:36:41 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk"/>
Aug 01 08:36:41 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:36:41 user nova-compute[72426]:     </disk>
Aug 01 08:36:41 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:36:41 user nova-compute[72426]:       <mac address="fa:16:3e:0f:90:ce"/>
Aug 01 08:36:41 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:36:41 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:36:41 user nova-compute[72426]:       <target dev="tap2341ac13-4d"/>
Aug 01 08:36:41 user nova-compute[72426]:     </interface>
Aug 01 08:36:41 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:36:41 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/console.log" append="off"/>
Aug 01 08:36:41 user nova-compute[72426]:     </serial>
Aug 01 08:36:41 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:36:41 user nova-compute[72426]:     <video>
Aug 01 08:36:41 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:36:41 user nova-compute[72426]:     </video>
Aug 01 08:36:41 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:36:41 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:36:41 user nova-compute[72426]:     </rng>
Aug 01 08:36:41 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:36:41 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:36:41 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:36:41 user nova-compute[72426]:     </memballoon>
Aug 01 08:36:41 user nova-compute[72426]:   </devices>
Aug 01 08:36:41 user nova-compute[72426]: </domain>
Aug 01 08:36:41 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-201315796',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-201315796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2013157',id=49,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa/9a1G8HLWt4G3Cy8dhrQSlyxAHvMAYyYmeIkbe9H8CoJcxSnmVjXcwLGZfE7FLHLE7lTPCVoITdVeLP9em0p49Gk0O6Oiig+uIeCUn1FrSuajFCvYxPtg8KnTO9lDFw==',key_name='tempest-keypair-1734785821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a34680570c864d7aa0ff5269d0d73434',ramdisk_id='',reservation_id='r-wao90jaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2119158265',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c36f2803e634f008de831a9c38cb1c3',uuid=262464cd-ee17-433f-ac64-c6250c61af25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Converting VIF {"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=2341ac13-4d4d-40d6-9603-bd5277c46280,network=Network(fbfc064a-eaec-43c8-98f7-90d696ab641e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2341ac13-4d') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG os_vif [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=2341ac13-4d4d-40d6-9603-bd5277c46280,network=Network(fbfc064a-eaec-43c8-98f7-90d696ab641e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2341ac13-4d') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2341ac13-4d, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2341ac13-4d, col_values=(('external_ids', {'iface-id': '2341ac13-4d4d-40d6-9603-bd5277c46280', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:90:ce', 'vm-uuid': '262464cd-ee17-433f-ac64-c6250c61af25'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:41 user nova-compute[72426]: INFO os_vif [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=2341ac13-4d4d-40d6-9603-bd5277c46280,network=Network(fbfc064a-eaec-43c8-98f7-90d696ab641e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2341ac13-4d')
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] No VIF found with MAC fa:16:3e:0f:90:ce, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690878986.9412057, ef6878eb-686c-4121-afb1-2b2dfbe2aa50 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:36:41 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] VM Stopped (Lifecycle Event)
Aug 01 08:36:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-1aca33f9-b374-4282-8a15-ff20ee007584 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:36:42 user nova-compute[72426]: DEBUG nova.network.neutron [req-53b01d12-e285-4ab6-9ff6-a700b157a245 req-71bc9e64-23bd-4d5a-8527-ceafd657f4e5 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Updated VIF entry in instance network info cache for port 2341ac13-4d4d-40d6-9603-bd5277c46280. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:36:42 user nova-compute[72426]: DEBUG nova.network.neutron [req-53b01d12-e285-4ab6-9ff6-a700b157a245 req-71bc9e64-23bd-4d5a-8527-ceafd657f4e5 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Updating instance_info_cache with network_info: [{"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:36:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-53b01d12-e285-4ab6-9ff6-a700b157a245 req-71bc9e64-23bd-4d5a-8527-ceafd657f4e5 service nova] Releasing lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:36:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:42 user nova-compute[72426]: INFO nova.compute.manager [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Detaching volume 602d0edf-6d2a-4e92-8c04-b4172f1cc5a9
Aug 01 08:36:42 user nova-compute[72426]: INFO nova.virt.block_device [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Attempting to driver detach volume 602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 from mountpoint /dev/vdb
Aug 01 08:36:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Attempting to detach device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:36:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:36:42 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:36:42 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:36:42 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:36:42 user nova-compute[72426]:   <serial>602d0edf-6d2a-4e92-8c04-b4172f1cc5a9</serial>
Aug 01 08:36:42 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:36:42 user nova-compute[72426]: </disk>
Aug 01 08:36:42 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:36:42 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Successfully detached device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the persistent domain config.
Aug 01 08:36:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:36:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:36:42 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:36:42 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:36:42 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:36:42 user nova-compute[72426]:   <serial>602d0edf-6d2a-4e92-8c04-b4172f1cc5a9</serial>
Aug 01 08:36:42 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:36:42 user nova-compute[72426]: </disk>
Aug 01 08:36:42 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:36:42 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-1268d5d4-b5a7-4540-8f56-9243b5ac2f5f req-677c16c2-fad2-4497-848b-877d15ac16a8 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1268d5d4-b5a7-4540-8f56-9243b5ac2f5f req-677c16c2-fad2-4497-848b-877d15ac16a8 service nova] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1268d5d4-b5a7-4540-8f56-9243b5ac2f5f req-677c16c2-fad2-4497-848b-877d15ac16a8 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-1268d5d4-b5a7-4540-8f56-9243b5ac2f5f req-677c16c2-fad2-4497-848b-877d15ac16a8 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-1268d5d4-b5a7-4540-8f56-9243b5ac2f5f req-677c16c2-fad2-4497-848b-877d15ac16a8 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] No waiting events found dispatching network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:36:43 user nova-compute[72426]: WARNING nova.compute.manager [req-1268d5d4-b5a7-4540-8f56-9243b5ac2f5f req-677c16c2-fad2-4497-848b-877d15ac16a8 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received unexpected event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 for instance with vm_state building and task_state spawning.
Aug 01 08:36:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690879003.6196623, 81bf3e66-4c1d-46df-8756-b438aab31e1e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:36:43 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Successfully detached device vdb from instance 81bf3e66-4c1d-46df-8756-b438aab31e1e from the live domain config.
Aug 01 08:36:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWKnfigE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:36:43 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c189d4-b0d2-48cd-85d5-84da09c8b897]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48af905-3c70-44f5-bb0d-52bc366ca4c0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 (non-flash)
Aug 01 08:36:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 (non-flash)
Aug 01 08:36:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38fe1510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aff75f4-56ac-45f8-8201-f7c28735b8ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2760350-921f-4a59-867c-30218a9f911e]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbcd476-e0bd-487a-8de1-3c18ae104f9a]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[810996e0-dc5c-45b9-926b-4502958076a4]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d30b52-2ea8-49f4-a345-1c6bb8878588]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ec011e-e212-4d36-9e6a-1561f1146a49]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9, portal: 172.16.0.220,3260]
Aug 01 08:36:43 user nova-compute[72426]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9, portal: 172.16.0.220,3260] successful.
Aug 01 08:36:43 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:602d0edf-6d2a-4e92-8c04-b4172f1cc5a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b340b5c-fcfe-4b18-b6f3-eca839a1240b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] <== disconnect_volume: return (352ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:36:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:36:44 user nova-compute[72426]: DEBUG nova.objects.instance [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'flavor' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:36:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-fd16fedf-b673-4e44-9c34-5e8c00ae36d8 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.972s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-ccc3a50e-6bc6-4d16-b029-bee7a9d997f0 req-d5a00842-fd99-4e83-9ff0-9f3c6901f54c service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ccc3a50e-6bc6-4d16-b029-bee7a9d997f0 req-d5a00842-fd99-4e83-9ff0-9f3c6901f54c service nova] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ccc3a50e-6bc6-4d16-b029-bee7a9d997f0 req-d5a00842-fd99-4e83-9ff0-9f3c6901f54c service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ccc3a50e-6bc6-4d16-b029-bee7a9d997f0 req-d5a00842-fd99-4e83-9ff0-9f3c6901f54c service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-ccc3a50e-6bc6-4d16-b029-bee7a9d997f0 req-d5a00842-fd99-4e83-9ff0-9f3c6901f54c service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] No waiting events found dispatching network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:36:45 user nova-compute[72426]: WARNING nova.compute.manager [req-ccc3a50e-6bc6-4d16-b029-bee7a9d997f0 req-d5a00842-fd99-4e83-9ff0-9f3c6901f54c service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received unexpected event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 for instance with vm_state building and task_state spawning.
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690879005.4046903, 262464cd-ee17-433f-ac64-c6250c61af25 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:36:45 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] VM Resumed (Lifecycle Event)
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:36:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Instance spawned successfully.
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:36:45 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690879005.4059277, 262464cd-ee17-433f-ac64-c6250c61af25 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:36:45 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] VM Started (Lifecycle Event)
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:36:45 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:36:45 user nova-compute[72426]: INFO nova.compute.manager [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 01 08:36:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:36:45 user nova-compute[72426]: INFO nova.compute.manager [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Took 6.39 seconds to build instance.
Aug 01 08:36:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-ff43d0df-1c16-43ba-8f58-bfe58a341400 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.483s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:36:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:47 user nova-compute[72426]: INFO nova.compute.manager [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Terminating instance
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Skipping network cache update for instance because it is being deleted. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-65d62137-1f3c-4454-b38b-ce1babf5d5c2 req-785578ee-4c2e-40eb-9872-c811afa216b4 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received event network-vif-unplugged-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-65d62137-1f3c-4454-b38b-ce1babf5d5c2 req-785578ee-4c2e-40eb-9872-c811afa216b4 service nova] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-65d62137-1f3c-4454-b38b-ce1babf5d5c2 req-785578ee-4c2e-40eb-9872-c811afa216b4 service nova] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-65d62137-1f3c-4454-b38b-ce1babf5d5c2 req-785578ee-4c2e-40eb-9872-c811afa216b4 service nova] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-65d62137-1f3c-4454-b38b-ce1babf5d5c2 req-785578ee-4c2e-40eb-9872-c811afa216b4 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] No waiting events found dispatching network-vif-unplugged-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-65d62137-1f3c-4454-b38b-ce1babf5d5c2 req-785578ee-4c2e-40eb-9872-c811afa216b4 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received event network-vif-unplugged-7c6e3391-ff14-484f-b749-0743a1278469 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:36:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Instance destroyed successfully.
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.objects.instance [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'resources' on Instance uuid 6fd5c82f-6b6e-48d8-a977-af76a121cd5d {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1279142521',display_name='tempest-AttachVolumeNegativeTest-server-1279142521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1279142521',id=46,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhWNwcP2Nif+SwcAoVauoL89WbZVYCbB1HuKbWY30gQsusGbGrcmJUg5HUfpe1TZiq82JxrbQ+yPwIfJE+xpbrMwIJSvWZYyyEoD+mAghqV/mMh185+UTn0ubbkAv+Zmw==',key_name='tempest-keypair-2030940746',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:33:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-f7tcm9kc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=6fd5c82f-6b6e-48d8-a977-af76a121cd5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "7c6e3391-ff14-484f-b749-0743a1278469", "address": "fa:16:3e:7a:00:4f", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6e3391-ff", "ovs_interfaceid": "7c6e3391-ff14-484f-b749-0743a1278469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:00:4f,bridge_name='br-int',has_traffic_filtering=True,id=7c6e3391-ff14-484f-b749-0743a1278469,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6e3391-ff') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG os_vif [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:00:4f,bridge_name='br-int',has_traffic_filtering=True,id=7c6e3391-ff14-484f-b749-0743a1278469,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6e3391-ff') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c6e3391-ff, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:47 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:36:47 user nova-compute[72426]: INFO os_vif [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:00:4f,bridge_name='br-int',has_traffic_filtering=True,id=7c6e3391-ff14-484f-b749-0743a1278469,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6e3391-ff')
Aug 01 08:36:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Deleting instance files /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d_del
Aug 01 08:36:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Deletion of /opt/stack/data/nova/instances/6fd5c82f-6b6e-48d8-a977-af76a121cd5d_del complete
Aug 01 08:36:48 user nova-compute[72426]: INFO nova.compute.manager [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 08:36:48 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:36:48 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:36:48 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:36:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:48 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:36:48 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:36:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:36:49 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Took 1.01 seconds to deallocate network for instance.
Aug 01 08:36:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-e05a298e-0726-469e-9054-c46fd52cac2d req-17cd93dd-1b18-4b20-b4af-8a17ddb82d50 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received event network-vif-deleted-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:49 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Deleted allocations for instance 6fd5c82f-6b6e-48d8-a977-af76a121cd5d
Aug 01 08:36:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-20f5c602-cf56-4a62-b621-bffa26d6fb99 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.298s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-54f19b79-0546-42cd-8500-13c35a0f3462 req-b84dd6fa-057c-489c-9ff4-1fad3ea9e477 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received event network-vif-plugged-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-54f19b79-0546-42cd-8500-13c35a0f3462 req-b84dd6fa-057c-489c-9ff4-1fad3ea9e477 service nova] Acquiring lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-54f19b79-0546-42cd-8500-13c35a0f3462 req-b84dd6fa-057c-489c-9ff4-1fad3ea9e477 service nova] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-54f19b79-0546-42cd-8500-13c35a0f3462 req-b84dd6fa-057c-489c-9ff4-1fad3ea9e477 service nova] Lock "6fd5c82f-6b6e-48d8-a977-af76a121cd5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:36:49 user nova-compute[72426]: DEBUG nova.compute.manager [req-54f19b79-0546-42cd-8500-13c35a0f3462 req-b84dd6fa-057c-489c-9ff4-1fad3ea9e477 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] No waiting events found dispatching network-vif-plugged-7c6e3391-ff14-484f-b749-0743a1278469 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:36:49 user nova-compute[72426]: WARNING nova.compute.manager [req-54f19b79-0546-42cd-8500-13c35a0f3462 req-b84dd6fa-057c-489c-9ff4-1fad3ea9e477 service nova] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Received unexpected event network-vif-plugged-7c6e3391-ff14-484f-b749-0743a1278469 for instance with vm_state deleted and task_state None.
Aug 01 08:36:50 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:36:52 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:55 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:36:56 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:36:57 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:36:58 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:37:02 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690879007.9439213, 6fd5c82f-6b6e-48d8-a977-af76a121cd5d => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:37:02 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] VM Stopped (Lifecycle Event)
Aug 01 08:37:02 user nova-compute[72426]: DEBUG nova.compute.manager [None req-52a30ac2-e973-4f49-8e6f-1cea112fdf9c None None] [instance: 6fd5c82f-6b6e-48d8-a977-af76a121cd5d] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:37:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:17 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:22 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:27 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:32 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:37:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:37:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72426) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 08:37:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:37:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:37:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:40 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:37:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:37:40 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:37:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:40 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Starting instance... {{(pid=72426) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:37:41 user nova-compute[72426]: INFO nova.compute.claims [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Claim successful on node user
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Start building networks asynchronously for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG nova.compute.manager [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Allocating IP information in the background. {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG nova.network.neutron [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] allocate_for_instance() {{(pid=72426) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 08:37:41 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:37:41 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:37:41 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8364MB free_disk=25.317745208740234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:41 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:42 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Start building block device mappings for instance. {{(pid=72426) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 81bf3e66-4c1d-46df-8756-b438aab31e1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance fb9c5fe4-05a8-4a04-92b9-eef36b32f777 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 262464cd-ee17-433f-ac64-c6250c61af25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 21585d08-9e0b-4690-9273-c0bfb3cb40d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.policy [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53c85b986ed140c491cd0ed264e561c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d23fc511343c698af4392fc3de94b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72426) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.compute.manager [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Start spawning the instance on the hypervisor. {{(pid=72426) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:37:42 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Creating image(s)
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "/opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "/opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "/opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.147s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "b7aec31a31fbad90532641431fd94223fc697fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.141s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk 1073741824 {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9,backing_fmt=raw /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk 1073741824" returned: 0 in 0.053s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "b7aec31a31fbad90532641431fd94223fc697fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b7aec31a31fbad90532641431fd94223fc697fc9 --force-share --output=json" returned: 0 in 0.143s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk. size=1073741824 {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.network.neutron [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Successfully created port: 1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.virt.disk.api [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Cannot resize image /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk to a smaller size. {{(pid=72426) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.objects.instance [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'migration_context' on Instance uuid 21585d08-9e0b-4690-9273-c0bfb3cb40d1 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Created local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Ensure instance console log exists: /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:37:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Successfully updated port: 1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 08:37:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:37:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquired lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:37:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:37:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-ad3f8f03-0ce0-4c7c-96b1-bd7e62d222af req-ee246331-c5df-4ef8-8825-524a6c8e6ed1 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received event network-changed-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:37:43 user nova-compute[72426]: DEBUG nova.compute.manager [req-ad3f8f03-0ce0-4c7c-96b1-bd7e62d222af req-ee246331-c5df-4ef8-8825-524a6c8e6ed1 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Refreshing instance network info cache due to event network-changed-1a76a6d5-7822-4841-b5c0-a9f2a34f7545. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:37:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ad3f8f03-0ce0-4c7c-96b1-bd7e62d222af req-ee246331-c5df-4ef8-8825-524a6c8e6ed1 service nova] Acquiring lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:37:43 user nova-compute[72426]: DEBUG nova.network.neutron [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Instance cache missing network info. {{(pid=72426) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.network.neutron [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Updating instance_info_cache with network_info: [{"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Releasing lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.compute.manager [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Instance network_info: |[{"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72426) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ad3f8f03-0ce0-4c7c-96b1-bd7e62d222af req-ee246331-c5df-4ef8-8825-524a6c8e6ed1 service nova] Acquired lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.network.neutron [req-ad3f8f03-0ce0-4c7c-96b1-bd7e62d222af req-ee246331-c5df-4ef8-8825-524a6c8e6ed1 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Refreshing network info cache for port 1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Start _get_guest_xml network_info=[{"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd15c2a71-abe5-4334-bf77-67be8f572ede'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:37:44 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:37:44 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T08:04:45Z,direct_url=<?>,disk_format='qcow2',id=d15c2a71-abe5-4334-bf77-67be8f572ede,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='197aa2b20aa8460e817aa3af6d070fcc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T08:04:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:37:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1041718163',display_name='tempest-AttachVolumeNegativeTest-server-1041718163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1041718163',id=50,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUuTGwzvSvlasnS2yPOLex2ESeVhJFw3K2vWKB9SFUW4F9siT1nQRStBvWI88H1zaqVEAmcgb94rAbAaS8+wl4VCNfr+zcdETCFZg2ae3oq2KO6PgcNN4ERby2PkVS70Q==',key_name='tempest-keypair-1625201307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-jbttua7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:37:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=21585d08-9e0b-4690-9273-c0bfb3cb40d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=1a76a6d5-7822-4841-b5c0-a9f2a34f7545,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a76a6d5-78') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.objects.instance [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'pci_devices' on Instance uuid 21585d08-9e0b-4690-9273-c0bfb3cb40d1 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:37:44 user nova-compute[72426]:   <uuid>21585d08-9e0b-4690-9273-c0bfb3cb40d1</uuid>
Aug 01 08:37:44 user nova-compute[72426]:   <name>instance-00000032</name>
Aug 01 08:37:44 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:37:44 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:37:44 user nova-compute[72426]:   <metadata>
Aug 01 08:37:44 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:37:44 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:37:44 user nova-compute[72426]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1041718163</nova:name>
Aug 01 08:37:44 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:37:44</nova:creationTime>
Aug 01 08:37:44 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:37:44 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:37:44 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:37:44 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:37:44 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:37:44 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:37:44 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:37:44 user nova-compute[72426]:       <nova:owner>
Aug 01 08:37:44 user nova-compute[72426]:         <nova:user uuid="53c85b986ed140c491cd0ed264e561c7">tempest-AttachVolumeNegativeTest-1212503363-project-member</nova:user>
Aug 01 08:37:44 user nova-compute[72426]:         <nova:project uuid="0d0d23fc511343c698af4392fc3de94b">tempest-AttachVolumeNegativeTest-1212503363</nova:project>
Aug 01 08:37:44 user nova-compute[72426]:       </nova:owner>
Aug 01 08:37:44 user nova-compute[72426]:       <nova:root type="image" uuid="d15c2a71-abe5-4334-bf77-67be8f572ede"/>
Aug 01 08:37:44 user nova-compute[72426]:       <nova:ports>
Aug 01 08:37:44 user nova-compute[72426]:         <nova:port uuid="1a76a6d5-7822-4841-b5c0-a9f2a34f7545">
Aug 01 08:37:44 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 08:37:44 user nova-compute[72426]:         </nova:port>
Aug 01 08:37:44 user nova-compute[72426]:       </nova:ports>
Aug 01 08:37:44 user nova-compute[72426]:     </nova:instance>
Aug 01 08:37:44 user nova-compute[72426]:   </metadata>
Aug 01 08:37:44 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:37:44 user nova-compute[72426]:     <system>
Aug 01 08:37:44 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:37:44 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:37:44 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:37:44 user nova-compute[72426]:       <entry name="serial">21585d08-9e0b-4690-9273-c0bfb3cb40d1</entry>
Aug 01 08:37:44 user nova-compute[72426]:       <entry name="uuid">21585d08-9e0b-4690-9273-c0bfb3cb40d1</entry>
Aug 01 08:37:44 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:37:44 user nova-compute[72426]:     </system>
Aug 01 08:37:44 user nova-compute[72426]:   </sysinfo>
Aug 01 08:37:44 user nova-compute[72426]:   <os>
Aug 01 08:37:44 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:37:44 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:37:44 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:37:44 user nova-compute[72426]:   </os>
Aug 01 08:37:44 user nova-compute[72426]:   <features>
Aug 01 08:37:44 user nova-compute[72426]:     <acpi/>
Aug 01 08:37:44 user nova-compute[72426]:     <apic/>
Aug 01 08:37:44 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:37:44 user nova-compute[72426]:   </features>
Aug 01 08:37:44 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:37:44 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:37:44 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:37:44 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:37:44 user nova-compute[72426]:   </clock>
Aug 01 08:37:44 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:37:44 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:37:44 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:37:44 user nova-compute[72426]:   </cpu>
Aug 01 08:37:44 user nova-compute[72426]:   <devices>
Aug 01 08:37:44 user nova-compute[72426]:     <disk type="file" device="disk">
Aug 01 08:37:44 user nova-compute[72426]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 08:37:44 user nova-compute[72426]:       <source file="/opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk"/>
Aug 01 08:37:44 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:37:44 user nova-compute[72426]:     </disk>
Aug 01 08:37:44 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:37:44 user nova-compute[72426]:       <mac address="fa:16:3e:52:cb:dd"/>
Aug 01 08:37:44 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:37:44 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:37:44 user nova-compute[72426]:       <target dev="tap1a76a6d5-78"/>
Aug 01 08:37:44 user nova-compute[72426]:     </interface>
Aug 01 08:37:44 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:37:44 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/console.log" append="off"/>
Aug 01 08:37:44 user nova-compute[72426]:     </serial>
Aug 01 08:37:44 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:37:44 user nova-compute[72426]:     <video>
Aug 01 08:37:44 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:37:44 user nova-compute[72426]:     </video>
Aug 01 08:37:44 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:37:44 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:37:44 user nova-compute[72426]:     </rng>
Aug 01 08:37:44 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:37:44 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:37:44 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:37:44 user nova-compute[72426]:     </memballoon>
Aug 01 08:37:44 user nova-compute[72426]:   </devices>
Aug 01 08:37:44 user nova-compute[72426]: </domain>
Aug 01 08:37:44 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:37:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1041718163',display_name='tempest-AttachVolumeNegativeTest-server-1041718163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1041718163',id=50,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUuTGwzvSvlasnS2yPOLex2ESeVhJFw3K2vWKB9SFUW4F9siT1nQRStBvWI88H1zaqVEAmcgb94rAbAaS8+wl4VCNfr+zcdETCFZg2ae3oq2KO6PgcNN4ERby2PkVS70Q==',key_name='tempest-keypair-1625201307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-jbttua7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T08:37:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=21585d08-9e0b-4690-9273-c0bfb3cb40d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=1a76a6d5-7822-4841-b5c0-a9f2a34f7545,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a76a6d5-78') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG os_vif [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=1a76a6d5-7822-4841-b5c0-a9f2a34f7545,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a76a6d5-78') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a76a6d5-78, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a76a6d5-78, col_values=(('external_ids', {'iface-id': '1a76a6d5-7822-4841-b5c0-a9f2a34f7545', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:cb:dd', 'vm-uuid': '21585d08-9e0b-4690-9273-c0bfb3cb40d1'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:44 user nova-compute[72426]: INFO os_vif [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=1a76a6d5-7822-4841-b5c0-a9f2a34f7545,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a76a6d5-78')
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No VIF found with MAC fa:16:3e:52:cb:dd, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.network.neutron [req-ad3f8f03-0ce0-4c7c-96b1-bd7e62d222af req-ee246331-c5df-4ef8-8825-524a6c8e6ed1 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Updated VIF entry in instance network info cache for port 1a76a6d5-7822-4841-b5c0-a9f2a34f7545. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG nova.network.neutron [req-ad3f8f03-0ce0-4c7c-96b1-bd7e62d222af req-ee246331-c5df-4ef8-8825-524a6c8e6ed1 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Updating instance_info_cache with network_info: [{"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:37:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-ad3f8f03-0ce0-4c7c-96b1-bd7e62d222af req-ee246331-c5df-4ef8-8825-524a6c8e6ed1 service nova] Releasing lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:37:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-c6ad6cec-1ad3-4529-af94-54dcfacdd683 req-dd035640-ebea-43c5-949e-4c11716004b5 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received event network-vif-plugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:37:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c6ad6cec-1ad3-4529-af94-54dcfacdd683 req-dd035640-ebea-43c5-949e-4c11716004b5 service nova] Acquiring lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c6ad6cec-1ad3-4529-af94-54dcfacdd683 req-dd035640-ebea-43c5-949e-4c11716004b5 service nova] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c6ad6cec-1ad3-4529-af94-54dcfacdd683 req-dd035640-ebea-43c5-949e-4c11716004b5 service nova] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:37:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-c6ad6cec-1ad3-4529-af94-54dcfacdd683 req-dd035640-ebea-43c5-949e-4c11716004b5 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] No waiting events found dispatching network-vif-plugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:37:45 user nova-compute[72426]: WARNING nova.compute.manager [req-c6ad6cec-1ad3-4529-af94-54dcfacdd683 req-dd035640-ebea-43c5-949e-4c11716004b5 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received unexpected event network-vif-plugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 for instance with vm_state building and task_state spawning.
Aug 01 08:37:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690879067.7845025, 21585d08-9e0b-4690-9273-c0bfb3cb40d1 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:37:47 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] VM Resumed (Lifecycle Event)
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:37:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Instance spawned successfully.
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Found default for hw_cdrom_bus of ide {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Found default for hw_disk_bus of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Found default for hw_input_bus of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Found default for hw_pointer_model of None {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Found default for hw_video_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Found default for hw_vif_model of virtio {{(pid=72426) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 08:37:47 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690879067.785834, 21585d08-9e0b-4690-9273-c0bfb3cb40d1 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:37:47 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] VM Started (Lifecycle Event)
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:37:47 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:37:47 user nova-compute[72426]: INFO nova.compute.manager [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.compute.manager [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-a45ed8da-2b23-40da-aab5-80a2f4c8b180 req-e9a32d8c-88fb-48e1-b863-04afec86eb97 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received event network-vif-plugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a45ed8da-2b23-40da-aab5-80a2f4c8b180 req-e9a32d8c-88fb-48e1-b863-04afec86eb97 service nova] Acquiring lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a45ed8da-2b23-40da-aab5-80a2f4c8b180 req-e9a32d8c-88fb-48e1-b863-04afec86eb97 service nova] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-a45ed8da-2b23-40da-aab5-80a2f4c8b180 req-e9a32d8c-88fb-48e1-b863-04afec86eb97 service nova] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:37:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-a45ed8da-2b23-40da-aab5-80a2f4c8b180 req-e9a32d8c-88fb-48e1-b863-04afec86eb97 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] No waiting events found dispatching network-vif-plugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:37:47 user nova-compute[72426]: WARNING nova.compute.manager [req-a45ed8da-2b23-40da-aab5-80a2f4c8b180 req-e9a32d8c-88fb-48e1-b863-04afec86eb97 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received unexpected event network-vif-plugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 for instance with vm_state building and task_state spawning.
Aug 01 08:37:48 user nova-compute[72426]: INFO nova.compute.manager [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Took 6.86 seconds to build instance.
Aug 01 08:37:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-11421fea-24b0-4d8c-9001-da4dce9ec622 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.998s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:37:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:37:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:37:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:37:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:37:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:37:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:37:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:37:49 user nova-compute[72426]: DEBUG nova.objects.instance [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lazy-loading 'info_cache' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:37:50 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating instance_info_cache with network_info: [{"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:37:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-81bf3e66-4c1d-46df-8756-b438aab31e1e" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:37:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:37:50 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:37:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:37:51 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:37:52 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:37:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-6c238f33-0ed0-4698-8d05-2da8af900cfb req-ef0c0032-94ef-444c-8154-50a1282a0df8 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received event network-changed-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:37:53 user nova-compute[72426]: DEBUG nova.compute.manager [req-6c238f33-0ed0-4698-8d05-2da8af900cfb req-ef0c0032-94ef-444c-8154-50a1282a0df8 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Refreshing instance network info cache due to event network-changed-14bbb71b-466c-483f-b903-3d862c466b46. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:37:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6c238f33-0ed0-4698-8d05-2da8af900cfb req-ef0c0032-94ef-444c-8154-50a1282a0df8 service nova] Acquiring lock "refresh_cache-fb9c5fe4-05a8-4a04-92b9-eef36b32f777" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:37:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6c238f33-0ed0-4698-8d05-2da8af900cfb req-ef0c0032-94ef-444c-8154-50a1282a0df8 service nova] Acquired lock "refresh_cache-fb9c5fe4-05a8-4a04-92b9-eef36b32f777" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:37:53 user nova-compute[72426]: DEBUG nova.network.neutron [req-6c238f33-0ed0-4698-8d05-2da8af900cfb req-ef0c0032-94ef-444c-8154-50a1282a0df8 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Refreshing network info cache for port 14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:37:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:53 user nova-compute[72426]: DEBUG nova.objects.instance [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'flavor' on Instance uuid fb9c5fe4-05a8-4a04-92b9-eef36b32f777 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:37:53 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Ignoring supplied device name: /dev/vdb
Aug 01 08:37:53 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:37:54 user nova-compute[72426]: INFO nova.compute.manager [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Attaching volume 1fe791dd-9cb9-40c9-83a0-0ca1ec580601 to /dev/vdb
Aug 01 08:37:54 user nova-compute[72426]: DEBUG nova.network.neutron [req-6c238f33-0ed0-4698-8d05-2da8af900cfb req-ef0c0032-94ef-444c-8154-50a1282a0df8 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Updated VIF entry in instance network info cache for port 14bbb71b-466c-483f-b903-3d862c466b46. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG nova.network.neutron [req-6c238f33-0ed0-4698-8d05-2da8af900cfb req-ef0c0032-94ef-444c-8154-50a1282a0df8 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Updating instance_info_cache with network_info: [{"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG os_brick.utils [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-6c238f33-0ed0-4698-8d05-2da8af900cfb req-ef0c0032-94ef-444c-8154-50a1282a0df8 service nova] Releasing lock "refresh_cache-fb9c5fe4-05a8-4a04-92b9-eef36b32f777" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c13226-d810-4a61-a893-449d44a20847]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f59e077-5310-4efc-93e3-8589938269f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae75b307-b0e2-488b-9134-c3102f7aefa0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e03aeb6-af07-4000-8cff-3829011c11dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:37:54 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:37:54 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e386a39a-be57-4246-b5ac-56c3e3b66c7c]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG os_brick.utils [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Updating existing volume attachment record: 3a208007-70b7-4e95-9dd0-241d127be9fe {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:37:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:55 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:37:57 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:37:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:37:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mouynZYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:38:02 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:38:02 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:38:02 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c838a-e09e-4836-9c3b-025c6962fa24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:38:02 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f43af24-2870-443a-b249-c2416ad06d97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601] added
Aug 01 08:38:02 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[27545742-6022-4cf9-a641-88e2821f1f60]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a390dcce-e2ed-4d44-97c7-6d25de21cbd7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mouynZYX {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mouynZYX" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[45472924-428a-4757-bc3f-0c4270e9dff8]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mouynZYX'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a5c582-7533-4951-9829-1ba27132cbef]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5758f3e-ce36-4187-b949-72f9df85e301]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:38:02 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:38:02 user nova-compute[72426]:  {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:38:02 user nova-compute[72426]: WARNING os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 08:38:02 user nova-compute[72426]: 
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[626e787c-7623-4420-bbcb-adac778139ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601, portal: 172.16.0.220,3260]
Aug 01 08:38:02 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601, portal: 172.16.0.220,3260] successful.
Aug 01 08:38:02 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cf2cbb-255f-4a17-a35f-6fea2568e72b]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c61c048-3743-4467-8fc5-095adc1077e8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 (non-flash)
Aug 01 08:38:02 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 (non-flash)
Aug 01 08:38:02 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fe068c-9139-4705-91aa-34b1a57e94e0]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:02 user nova-compute[72426]: INFO nova.compute.manager [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Terminating instance
Aug 01 08:38:02 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:02 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-c3ced6fa-6a63-41da-83c4-9a76345f15dd req-a568fae1-089f-41e1-8198-6aaf12812815 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received event network-vif-unplugged-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c3ced6fa-6a63-41da-83c4-9a76345f15dd req-a568fae1-089f-41e1-8198-6aaf12812815 service nova] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c3ced6fa-6a63-41da-83c4-9a76345f15dd req-a568fae1-089f-41e1-8198-6aaf12812815 service nova] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c3ced6fa-6a63-41da-83c4-9a76345f15dd req-a568fae1-089f-41e1-8198-6aaf12812815 service nova] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-c3ced6fa-6a63-41da-83c4-9a76345f15dd req-a568fae1-089f-41e1-8198-6aaf12812815 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] No waiting events found dispatching network-vif-unplugged-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.compute.manager [req-c3ced6fa-6a63-41da-83c4-9a76345f15dd req-a568fae1-089f-41e1-8198-6aaf12812815 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received event network-vif-unplugged-f441a355-3ad1-4c5a-8062-fc376068e465 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mouynZYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26166626239353536', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166626239353536', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.objects.instance [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'flavor' on Instance uuid fb9c5fe4-05a8-4a04-92b9-eef36b32f777 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:38:03 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:38:03 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:38:03 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:38:03 user nova-compute[72426]:   <serial>1fe791dd-9cb9-40c9-83a0-0ca1ec580601</serial>
Aug 01 08:38:03 user nova-compute[72426]: </disk>
Aug 01 08:38:03 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Instance destroyed successfully.
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.objects.instance [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lazy-loading 'resources' on Instance uuid 81bf3e66-4c1d-46df-8756-b438aab31e1e {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-515220998',display_name='tempest-SnapshotDataIntegrityTests-server-515220998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-515220998',id=44,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVIt77/GFD+u/Cv2/KGuImcjOC7sl3Zu7zWYs4XoX0CzGc/RS3eAB10A0ql00A5Cfo/VEm2KQRwBU3hYQng+y9FxjgvwDUcIWSFC91grtFMm87+3IOvIELGLbTdDgXaQw==',key_name='tempest-keypair-1823084927',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93114c346ec34c6a9d5607f81475643a',ramdisk_id='',reservation_id='r-0sd8fmwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-517942142',owner_user_name='tempest-SnapshotDataIntegrityTests-517942142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b17572488ab4d3eb1f951149cc002a2',uuid=81bf3e66-4c1d-46df-8756-b438aab31e1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Converting VIF {"id": "f441a355-3ad1-4c5a-8062-fc376068e465", "address": "fa:16:3e:d3:93:15", "network": {"id": "3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1435678685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93114c346ec34c6a9d5607f81475643a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf441a355-3a", "ovs_interfaceid": "f441a355-3ad1-4c5a-8062-fc376068e465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:93:15,bridge_name='br-int',has_traffic_filtering=True,id=f441a355-3ad1-4c5a-8062-fc376068e465,network=Network(3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf441a355-3a') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG os_vif [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:93:15,bridge_name='br-int',has_traffic_filtering=True,id=f441a355-3ad1-4c5a-8062-fc376068e465,network=Network(3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf441a355-3a') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf441a355-3a, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:03 user nova-compute[72426]: INFO os_vif [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:93:15,bridge_name='br-int',has_traffic_filtering=True,id=f441a355-3ad1-4c5a-8062-fc376068e465,network=Network(3e9897f6-a72e-4c9d-8ccc-d25fd1b7c74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf441a355-3a')
Aug 01 08:38:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Deleting instance files /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e_del
Aug 01 08:38:03 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Deletion of /opt/stack/data/nova/instances/81bf3e66-4c1d-46df-8756-b438aab31e1e_del complete
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] No VIF found with MAC fa:16:3e:67:94:3a, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:38:03 user nova-compute[72426]: INFO nova.compute.manager [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 01 08:38:03 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:38:03 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6681e084-1d0d-4d4a-9c98-f4665e4646ad tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.871s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:04 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:38:04 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Took 1.04 seconds to deallocate network for instance.
Aug 01 08:38:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-068b80af-5ca0-459b-9bf7-c2fd73879a87 req-c7e77b2c-441b-4e9c-b14c-ab9450b3be51 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received event network-vif-deleted-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:38:04 user nova-compute[72426]: INFO nova.compute.manager [req-068b80af-5ca0-459b-9bf7-c2fd73879a87 req-c7e77b2c-441b-4e9c-b14c-ab9450b3be51 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Neutron deleted interface f441a355-3ad1-4c5a-8062-fc376068e465; detaching it from the instance and deleting it from the info cache
Aug 01 08:38:04 user nova-compute[72426]: DEBUG nova.network.neutron [req-068b80af-5ca0-459b-9bf7-c2fd73879a87 req-c7e77b2c-441b-4e9c-b14c-ab9450b3be51 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:38:04 user nova-compute[72426]: DEBUG nova.compute.manager [req-068b80af-5ca0-459b-9bf7-c2fd73879a87 req-c7e77b2c-441b-4e9c-b14c-ab9450b3be51 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Detach interface failed, port_id=f441a355-3ad1-4c5a-8062-fc376068e465, reason: Instance 81bf3e66-4c1d-46df-8756-b438aab31e1e could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:38:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:04 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-c2cd387c-d424-4d31-a708-8c17422a9d85 req-24624e31-ee3c-4fa2-8214-df594651ff50 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received event network-vif-plugged-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:38:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c2cd387c-d424-4d31-a708-8c17422a9d85 req-24624e31-ee3c-4fa2-8214-df594651ff50 service nova] Acquiring lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c2cd387c-d424-4d31-a708-8c17422a9d85 req-24624e31-ee3c-4fa2-8214-df594651ff50 service nova] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-c2cd387c-d424-4d31-a708-8c17422a9d85 req-24624e31-ee3c-4fa2-8214-df594651ff50 service nova] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:05 user nova-compute[72426]: DEBUG nova.compute.manager [req-c2cd387c-d424-4d31-a708-8c17422a9d85 req-24624e31-ee3c-4fa2-8214-df594651ff50 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] No waiting events found dispatching network-vif-plugged-f441a355-3ad1-4c5a-8062-fc376068e465 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:38:05 user nova-compute[72426]: WARNING nova.compute.manager [req-c2cd387c-d424-4d31-a708-8c17422a9d85 req-24624e31-ee3c-4fa2-8214-df594651ff50 service nova] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Received unexpected event network-vif-plugged-f441a355-3ad1-4c5a-8062-fc376068e465 for instance with vm_state deleted and task_state None.
Aug 01 08:38:05 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:38:05 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:38:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:05 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Deleted allocations for instance 81bf3e66-4c1d-46df-8756-b438aab31e1e
Aug 01 08:38:05 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-c9a05e48-d787-4be9-af9e-8d22d2a776b3 tempest-SnapshotDataIntegrityTests-517942142 tempest-SnapshotDataIntegrityTests-517942142-project-member] Lock "81bf3e66-4c1d-46df-8756-b438aab31e1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.587s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:17 user nova-compute[72426]: INFO nova.compute.manager [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Unshelving
Aug 01 08:38:17 user nova-compute[72426]: INFO nova.virt.block_device [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Booting with volume 17dd5f10-29eb-428c-afc0-fa602ea1c54b at /dev/vda
Aug 01 08:38:17 user nova-compute[72426]: DEBUG os_brick.utils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e085a215-370b-45cc-a265-721008be0142]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbb1f73-61e3-423e-a067-61bf8a1899bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0f6064-2172-475d-834b-81751bbc56cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f485a79a-2a06-4ff0-b6f7-57863e88e9cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:38:17 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:38:17 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded3f766-8c30-4fd3-8ea9-b03ebf1e71ed]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG os_brick.utils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:38:17 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating existing volume attachment record: 3333ff26-aaa9-4a14-a904-9703e55651ec {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:38:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:18 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690879083.7317588, 81bf3e66-4c1d-46df-8756-b438aab31e1e => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:38:18 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] VM Stopped (Lifecycle Event)
Aug 01 08:38:18 user nova-compute[72426]: DEBUG nova.compute.manager [None req-c08f9cdb-d5c4-4254-843f-59fc8e4d7410 None None] [instance: 81bf3e66-4c1d-46df-8756-b438aab31e1e] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:38:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:23 user nova-compute[72426]: INFO nova.compute.manager [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Detaching volume 1fe791dd-9cb9-40c9-83a0-0ca1ec580601
Aug 01 08:38:23 user nova-compute[72426]: INFO nova.virt.block_device [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Attempting to driver detach volume 1fe791dd-9cb9-40c9-83a0-0ca1ec580601 from mountpoint /dev/vdb
Aug 01 08:38:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Attempting to detach device vdb from instance fb9c5fe4-05a8-4a04-92b9-eef36b32f777 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:38:23 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:38:23 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:38:23 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:38:23 user nova-compute[72426]:   <serial>1fe791dd-9cb9-40c9-83a0-0ca1ec580601</serial>
Aug 01 08:38:23 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:38:23 user nova-compute[72426]: </disk>
Aug 01 08:38:23 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:38:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Successfully detached device vdb from instance fb9c5fe4-05a8-4a04-92b9-eef36b32f777 from the persistent domain config.
Aug 01 08:38:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb9c5fe4-05a8-4a04-92b9-eef36b32f777 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:38:23 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:38:23 user nova-compute[72426]:   <source dev="/dev/sdb"/>
Aug 01 08:38:23 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:38:23 user nova-compute[72426]:   <serial>1fe791dd-9cb9-40c9-83a0-0ca1ec580601</serial>
Aug 01 08:38:23 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:38:23 user nova-compute[72426]: </disk>
Aug 01 08:38:23 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690879103.837409, fb9c5fe4-05a8-4a04-92b9-eef36b32f777 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb9c5fe4-05a8-4a04-92b9-eef36b32f777 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:38:23 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Successfully detached device vdb from instance fb9c5fe4-05a8-4a04-92b9-eef36b32f777 from the live domain config.
Aug 01 08:38:23 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mouynZYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:38:23 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:38:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c547c3-738b-4b10-a517-42c2ef3e390a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb59ffc-ea33-4f4d-b47a-f926e54680b4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 (non-flash)
Aug 01 08:38:23 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 (non-flash)
Aug 01 08:38:23 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38c4d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abf1b71-27bc-4406-af46-f5a37c2bfee3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da1fe79-4498-47d5-ac2c-7d1a6ea42a49]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1970671e-b455-42c8-a1ca-28f43a65a6e4]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:38:23 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb337820-aeb7-4547-b369-c006f7925ff5]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07f4358-b236-4b0f-b81a-6f9035814ce4]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[280c867b-b19f-4af2-8f98-3a12d9b84015]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601, portal: 172.16.0.220,3260]
Aug 01 08:38:24 user nova-compute[72426]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601, portal: 172.16.0.220,3260] successful.
Aug 01 08:38:24 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[729e92e4-e5fd-494a-a88c-feb7baec8413]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] <== disconnect_volume: return (276ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG nova.objects.instance [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'flavor' on Instance uuid fb9c5fe4-05a8-4a04-92b9-eef36b32f777 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-0e5c06a6-d7a3-466b-b936-f4517dba341f tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.627s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.496s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:24 user nova-compute[72426]: INFO nova.compute.manager [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Terminating instance
Aug 01 08:38:24 user nova-compute[72426]: DEBUG nova.compute.manager [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:38:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.objects.instance [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lazy-loading 'pci_requests' on Instance uuid ef6878eb-686c-4121-afb1-2b2dfbe2aa50 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.objects.instance [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lazy-loading 'numa_topology' on Instance uuid ef6878eb-686c-4121-afb1-2b2dfbe2aa50 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72426) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 08:38:25 user nova-compute[72426]: INFO nova.compute.claims [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Claim successful on node user
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-b2cc0ec7-5e36-46f7-9888-92dc0093cb75 req-9fe09470-26b0-4d1f-84c2-4e63949ae999 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received event network-vif-unplugged-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b2cc0ec7-5e36-46f7-9888-92dc0093cb75 req-9fe09470-26b0-4d1f-84c2-4e63949ae999 service nova] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b2cc0ec7-5e36-46f7-9888-92dc0093cb75 req-9fe09470-26b0-4d1f-84c2-4e63949ae999 service nova] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-b2cc0ec7-5e36-46f7-9888-92dc0093cb75 req-9fe09470-26b0-4d1f-84c2-4e63949ae999 service nova] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-b2cc0ec7-5e36-46f7-9888-92dc0093cb75 req-9fe09470-26b0-4d1f-84c2-4e63949ae999 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] No waiting events found dispatching network-vif-unplugged-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.compute.manager [req-b2cc0ec7-5e36-46f7-9888-92dc0093cb75 req-9fe09470-26b0-4d1f-84c2-4e63949ae999 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received event network-vif-unplugged-14bbb71b-466c-483f-b903-3d862c466b46 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:25 user nova-compute[72426]: INFO nova.network.neutron [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 08:38:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Instance destroyed successfully.
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.objects.instance [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lazy-loading 'resources' on Instance uuid fb9c5fe4-05a8-4a04-92b9-eef36b32f777 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-75632591',display_name='tempest-VolumesSnapshotTestJSON-instance-75632591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-75632591',id=48,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7gue+vba+SAqJb3PECo4qz55ukMJHrRGc3C7N/NLfZrs62bPddRxVssD8BZquEuRrLjxyGweNH3VwEZLR2DKWSsofs31wANXElFXW2QNJseT2IifW/brC7NDzsHLpVOQ==',key_name='tempest-keypair-272780877',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:36:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af75edfbd8534a9c84575464a28cdb67',ramdisk_id='',reservation_id='r-rgkv823j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-568043323',owner_user_name='tempest-VolumesSnapshotTestJSON-568043323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:36:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58361e4852e8467790067d63012c7ac1',uuid=fb9c5fe4-05a8-4a04-92b9-eef36b32f777,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converting VIF {"id": "14bbb71b-466c-483f-b903-3d862c466b46", "address": "fa:16:3e:67:94:3a", "network": {"id": "98990dc9-981f-4dfd-b0cd-1ca8846e221c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-738977783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af75edfbd8534a9c84575464a28cdb67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14bbb71b-46", "ovs_interfaceid": "14bbb71b-466c-483f-b903-3d862c466b46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:94:3a,bridge_name='br-int',has_traffic_filtering=True,id=14bbb71b-466c-483f-b903-3d862c466b46,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14bbb71b-46') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_vif [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:94:3a,bridge_name='br-int',has_traffic_filtering=True,id=14bbb71b-466c-483f-b903-3d862c466b46,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14bbb71b-46') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14bbb71b-46, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:38:25 user nova-compute[72426]: INFO os_vif [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:94:3a,bridge_name='br-int',has_traffic_filtering=True,id=14bbb71b-466c-483f-b903-3d862c466b46,network=Network(98990dc9-981f-4dfd-b0cd-1ca8846e221c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14bbb71b-46')
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mouynZYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:38:25 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fe791dd-9cb9-40c9-83a0-0ca1ec580601', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7443dc02-0dc4-4e47-9cc8-fce3ef247993]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:25 user nova-compute[72426]: WARNING os_brick.initiator.connectors.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 01 08:38:25 user nova-compute[72426]: 
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0978e932-a0a6-4a42-a6d1-5b6f5e3f327a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:38:25 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:38:25 user nova-compute[72426]:  {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:38:25 user nova-compute[72426]: WARNING os_brick.initiator.connectors.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 08:38:25 user nova-compute[72426]: 
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38bf2560>, {}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Disconnecting from: [] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] <== disconnect_volume: return (47ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:38:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Deleting instance files /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777_del
Aug 01 08:38:25 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Deletion of /opt/stack/data/nova/instances/fb9c5fe4-05a8-4a04-92b9-eef36b32f777_del complete
Aug 01 08:38:25 user nova-compute[72426]: INFO nova.compute.manager [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 01 08:38:25 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:38:25 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquired lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.network.neutron [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Building network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received event network-vif-plugged-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] Acquiring lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] No waiting events found dispatching network-vif-plugged-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:38:27 user nova-compute[72426]: WARNING nova.compute.manager [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received unexpected event network-vif-plugged-14bbb71b-466c-483f-b903-3d862c466b46 for instance with vm_state active and task_state deleting.
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-changed-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.compute.manager [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Refreshing instance network info cache due to event network-changed-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] Acquiring lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:38:27 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Took 1.82 seconds to deallocate network for instance.
Aug 01 08:38:27 user nova-compute[72426]: WARNING nova.volume.cinder [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Attachment 3a208007-70b7-4e95-9dd0-241d127be9fe does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3a208007-70b7-4e95-9dd0-241d127be9fe. (HTTP 404) (Request-ID: req-e3f885cf-8bc1-466b-b247-dcc41454fd8d)
Aug 01 08:38:27 user nova-compute[72426]: INFO nova.compute.manager [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Took 0.02 seconds to detach 1 volumes for instance.
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.network.neutron [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating instance_info_cache with network_info: [{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Releasing lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Creating instance directory {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 08:38:27 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Creating image(s)
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Did not create local disks {{(pid=72426) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Ensure instance console log exists: /opt/stack/data/nova/instances/ef6878eb-686c-4121-afb1-2b2dfbe2aa50/console.log {{(pid=72426) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Start _get_guest_xml network_info=[{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAgGVsZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef6878eb-686c-4121-afb1-2b2dfbe2aa50', 'attached_at': '', 'detached_at': '', 'volume_id': '17dd5f10-29eb-428c-afc0-fa602ea1c54b', 'serial': '17dd5f10-29eb-428c-afc0-fa602ea1c54b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'attachment_id': '3333ff26-aaa9-4a14-a904-9703e55651ec', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] Acquired lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.network.neutron [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Refreshing network info cache for port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:38:27 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:38:27 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] CPU controller missing on host. {{(pid=72426) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.host [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] CPU controller found on host. {{(pid=72426) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72426) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T08:04:35Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Flavor limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Image limits 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Flavor pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Image pref 0:0:0 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Got 1 possible topologies {{(pid=72426) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.hardware [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72426) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.objects.instance [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lazy-loading 'vcpu_model' on Instance uuid ef6878eb-686c-4121-afb1-2b2dfbe2aa50 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAgGVsZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:38:27 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:38:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:38:27 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:38:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:38:27 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:38:27 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3a3e75-5f2b-43ef-a304-8c7c0abab486]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:38:27 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eeec7d-ae9f-40a1-91ef-7c0b341d0686]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b] added
Aug 01 08:38:27 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c82730a-2721-47ed-968c-428f4b72aeb9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:27 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:27 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Deleted allocations for instance fb9c5fe4-05a8-4a04-92b9-eef36b32f777
Aug 01 08:38:27 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b0b3d9-8f1e-419a-8b1c-35b674266498]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAgGVsZt {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAgGVsZt" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde2695b-38d2-4e0a-a5d9-731d1e1c14e7]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KAgGVsZt'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[03603a26-7582-4749-ac39-69d3605fd7fb]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-7f4a749b-95b0-4822-97f1-0a303bdfc5a8 tempest-VolumesSnapshotTestJSON-568043323 tempest-VolumesSnapshotTestJSON-568043323-project-member] Lock "fb9c5fe4-05a8-4a04-92b9-eef36b32f777" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.155s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1464fc52-30db-4acd-841f-6381ca0cbe68]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:38:28 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 08:38:28 user nova-compute[72426]:  {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:38:28 user nova-compute[72426]: WARNING os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 08:38:28 user nova-compute[72426]: 
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa307fed-1bb3-4418-9164-857875f9f4a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260]
Aug 01 08:38:28 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260] successful.
Aug 01 08:38:28 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6a9f9e-af1d-41c4-bf74-517a79738afb]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a661f81-0bec-4b63-a0b6-f1e12b002174]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:38:28 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:38:28 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7931d58d-f576-4468-bfae-680b5e5d5dca]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAgGVsZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG nova.network.neutron [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updated VIF entry in instance network info cache for port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG nova.network.neutron [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating instance_info_cache with network_info: [{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:38:28 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-519cb80c-964b-44fc-a9b0-f6c02aff94f2 req-a62c14ec-448e-4a5e-9ff2-dbdbef738931 service nova] Releasing lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23338343339363862', 'path': '/dev/sdb'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338343339363862', 'path': '/dev/sdb'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516230263',display_name='tempest-TestShelveInstance-server-1516230263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516230263',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1365898974',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0a265b55817a4ee5abb5d363e09e53b5',ramdisk_id='',reservation_id='r-z7j7mj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-787444776',owner_user_name='tempest-TestShelveInstance-787444776-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:38:18Z,user_data=None,user_id='afa99527453b4d92a9737db9a6e7e51a',uuid=ef6878eb-686c-4121-afb1-2b2dfbe2aa50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72426) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converting VIF {"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.objects.instance [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lazy-loading 'pci_devices' on Instance uuid ef6878eb-686c-4121-afb1-2b2dfbe2aa50 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] End _get_guest_xml xml=<domain type="kvm">
Aug 01 08:38:29 user nova-compute[72426]:   <uuid>ef6878eb-686c-4121-afb1-2b2dfbe2aa50</uuid>
Aug 01 08:38:29 user nova-compute[72426]:   <name>instance-0000002f</name>
Aug 01 08:38:29 user nova-compute[72426]:   <memory>524288</memory>
Aug 01 08:38:29 user nova-compute[72426]:   <vcpu>1</vcpu>
Aug 01 08:38:29 user nova-compute[72426]:   <metadata>
Aug 01 08:38:29 user nova-compute[72426]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 08:38:29 user nova-compute[72426]:       <nova:package version="0.0.0"/>
Aug 01 08:38:29 user nova-compute[72426]:       <nova:name>tempest-TestShelveInstance-server-1516230263</nova:name>
Aug 01 08:38:29 user nova-compute[72426]:       <nova:creationTime>2023-08-01 08:38:27</nova:creationTime>
Aug 01 08:38:29 user nova-compute[72426]:       <nova:flavor name="m1.tiny">
Aug 01 08:38:29 user nova-compute[72426]:         <nova:memory>512</nova:memory>
Aug 01 08:38:29 user nova-compute[72426]:         <nova:disk>1</nova:disk>
Aug 01 08:38:29 user nova-compute[72426]:         <nova:swap>0</nova:swap>
Aug 01 08:38:29 user nova-compute[72426]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 08:38:29 user nova-compute[72426]:         <nova:vcpus>1</nova:vcpus>
Aug 01 08:38:29 user nova-compute[72426]:       </nova:flavor>
Aug 01 08:38:29 user nova-compute[72426]:       <nova:owner>
Aug 01 08:38:29 user nova-compute[72426]:         <nova:user uuid="afa99527453b4d92a9737db9a6e7e51a">tempest-TestShelveInstance-787444776-project-member</nova:user>
Aug 01 08:38:29 user nova-compute[72426]:         <nova:project uuid="0a265b55817a4ee5abb5d363e09e53b5">tempest-TestShelveInstance-787444776</nova:project>
Aug 01 08:38:29 user nova-compute[72426]:       </nova:owner>
Aug 01 08:38:29 user nova-compute[72426]:       <nova:ports>
Aug 01 08:38:29 user nova-compute[72426]:         <nova:port uuid="c1a9ec2e-8c85-4851-b96b-6caae5eb4ade">
Aug 01 08:38:29 user nova-compute[72426]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 08:38:29 user nova-compute[72426]:         </nova:port>
Aug 01 08:38:29 user nova-compute[72426]:       </nova:ports>
Aug 01 08:38:29 user nova-compute[72426]:     </nova:instance>
Aug 01 08:38:29 user nova-compute[72426]:   </metadata>
Aug 01 08:38:29 user nova-compute[72426]:   <sysinfo type="smbios">
Aug 01 08:38:29 user nova-compute[72426]:     <system>
Aug 01 08:38:29 user nova-compute[72426]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 08:38:29 user nova-compute[72426]:       <entry name="product">OpenStack Nova</entry>
Aug 01 08:38:29 user nova-compute[72426]:       <entry name="version">0.0.0</entry>
Aug 01 08:38:29 user nova-compute[72426]:       <entry name="serial">ef6878eb-686c-4121-afb1-2b2dfbe2aa50</entry>
Aug 01 08:38:29 user nova-compute[72426]:       <entry name="uuid">ef6878eb-686c-4121-afb1-2b2dfbe2aa50</entry>
Aug 01 08:38:29 user nova-compute[72426]:       <entry name="family">Virtual Machine</entry>
Aug 01 08:38:29 user nova-compute[72426]:     </system>
Aug 01 08:38:29 user nova-compute[72426]:   </sysinfo>
Aug 01 08:38:29 user nova-compute[72426]:   <os>
Aug 01 08:38:29 user nova-compute[72426]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 08:38:29 user nova-compute[72426]:     <boot dev="hd"/>
Aug 01 08:38:29 user nova-compute[72426]:     <smbios mode="sysinfo"/>
Aug 01 08:38:29 user nova-compute[72426]:   </os>
Aug 01 08:38:29 user nova-compute[72426]:   <features>
Aug 01 08:38:29 user nova-compute[72426]:     <acpi/>
Aug 01 08:38:29 user nova-compute[72426]:     <apic/>
Aug 01 08:38:29 user nova-compute[72426]:     <vmcoreinfo/>
Aug 01 08:38:29 user nova-compute[72426]:   </features>
Aug 01 08:38:29 user nova-compute[72426]:   <clock offset="utc">
Aug 01 08:38:29 user nova-compute[72426]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 08:38:29 user nova-compute[72426]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 08:38:29 user nova-compute[72426]:     <timer name="hpet" present="no"/>
Aug 01 08:38:29 user nova-compute[72426]:   </clock>
Aug 01 08:38:29 user nova-compute[72426]:   <cpu mode="custom" match="exact">
Aug 01 08:38:29 user nova-compute[72426]:     <model>Nehalem</model>
Aug 01 08:38:29 user nova-compute[72426]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 08:38:29 user nova-compute[72426]:   </cpu>
Aug 01 08:38:29 user nova-compute[72426]:   <devices>
Aug 01 08:38:29 user nova-compute[72426]:     <disk type="block" device="disk">
Aug 01 08:38:29 user nova-compute[72426]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:38:29 user nova-compute[72426]:       <source dev="/dev/sdb"/>
Aug 01 08:38:29 user nova-compute[72426]:       <target dev="vda" bus="virtio"/>
Aug 01 08:38:29 user nova-compute[72426]:       <serial>17dd5f10-29eb-428c-afc0-fa602ea1c54b</serial>
Aug 01 08:38:29 user nova-compute[72426]:     </disk>
Aug 01 08:38:29 user nova-compute[72426]:     <interface type="ethernet">
Aug 01 08:38:29 user nova-compute[72426]:       <mac address="fa:16:3e:46:9a:8e"/>
Aug 01 08:38:29 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:38:29 user nova-compute[72426]:       <mtu size="1442"/>
Aug 01 08:38:29 user nova-compute[72426]:       <target dev="tapc1a9ec2e-8c"/>
Aug 01 08:38:29 user nova-compute[72426]:     </interface>
Aug 01 08:38:29 user nova-compute[72426]:     <serial type="pty">
Aug 01 08:38:29 user nova-compute[72426]:       <log file="/opt/stack/data/nova/instances/ef6878eb-686c-4121-afb1-2b2dfbe2aa50/console.log" append="off"/>
Aug 01 08:38:29 user nova-compute[72426]:     </serial>
Aug 01 08:38:29 user nova-compute[72426]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 08:38:29 user nova-compute[72426]:     <video>
Aug 01 08:38:29 user nova-compute[72426]:       <model type="virtio"/>
Aug 01 08:38:29 user nova-compute[72426]:     </video>
Aug 01 08:38:29 user nova-compute[72426]:     <rng model="virtio">
Aug 01 08:38:29 user nova-compute[72426]:       <backend model="random">/dev/urandom</backend>
Aug 01 08:38:29 user nova-compute[72426]:     </rng>
Aug 01 08:38:29 user nova-compute[72426]:     <controller type="usb" index="0" model="none"/>
Aug 01 08:38:29 user nova-compute[72426]:     <memballoon model="virtio">
Aug 01 08:38:29 user nova-compute[72426]:       <stats period="10"/>
Aug 01 08:38:29 user nova-compute[72426]:     </memballoon>
Aug 01 08:38:29 user nova-compute[72426]:   </devices>
Aug 01 08:38:29 user nova-compute[72426]: </domain>
Aug 01 08:38:29 user nova-compute[72426]:  {{(pid=72426) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516230263',display_name='tempest-TestShelveInstance-server-1516230263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516230263',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1365898974',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0a265b55817a4ee5abb5d363e09e53b5',ramdisk_id='',reservation_id='r-z7j7mj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-787444776',owner_user_name='tempest-TestShelveInstance-787444776-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:38:18Z,user_data=None,user_id='afa99527453b4d92a9737db9a6e7e51a',uuid=ef6878eb-686c-4121-afb1-2b2dfbe2aa50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converting VIF {"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG os_vif [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c') {{(pid=72426) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1a9ec2e-8c, may_exist=True, interface_attrs={}) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1a9ec2e-8c, col_values=(('external_ids', {'iface-id': 'c1a9ec2e-8c85-4851-b96b-6caae5eb4ade', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:9a:8e', 'vm-uuid': 'ef6878eb-686c-4121-afb1-2b2dfbe2aa50'}),), if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:29 user nova-compute[72426]: INFO os_vif [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c')
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.compute.manager [req-4e5d8701-1113-457b-8e82-e8d5e719ba71 req-db1639d7-592c-47da-975a-75dcf7908cf8 service nova] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Received event network-vif-deleted-14bbb71b-466c-483f-b903-3d862c466b46 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:38:29 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] No VIF found with MAC fa:16:3e:46:9a:8e, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:38:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:30 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:30 user nova-compute[72426]: DEBUG nova.compute.manager [req-76bb5213-e8e7-417a-afec-aa6da185c3f9 req-85eeb039-4105-42e5-94ba-713d35c6e566 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:38:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-76bb5213-e8e7-417a-afec-aa6da185c3f9 req-85eeb039-4105-42e5-94ba-713d35c6e566 service nova] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-76bb5213-e8e7-417a-afec-aa6da185c3f9 req-85eeb039-4105-42e5-94ba-713d35c6e566 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:30 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-76bb5213-e8e7-417a-afec-aa6da185c3f9 req-85eeb039-4105-42e5-94ba-713d35c6e566 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:30 user nova-compute[72426]: DEBUG nova.compute.manager [req-76bb5213-e8e7-417a-afec-aa6da185c3f9 req-85eeb039-4105-42e5-94ba-713d35c6e566 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] No waiting events found dispatching network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:38:30 user nova-compute[72426]: WARNING nova.compute.manager [req-76bb5213-e8e7-417a-afec-aa6da185c3f9 req-85eeb039-4105-42e5-94ba-713d35c6e566 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received unexpected event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 08:38:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:31 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:31 user nova-compute[72426]: DEBUG nova.compute.manager [req-5137e5ce-2093-4062-8e8e-1d817b08b90c req-2d39caac-1ac7-433a-bc28-a99bf6ac2dcb service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-changed-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:38:31 user nova-compute[72426]: DEBUG nova.compute.manager [req-5137e5ce-2093-4062-8e8e-1d817b08b90c req-2d39caac-1ac7-433a-bc28-a99bf6ac2dcb service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Refreshing instance network info cache due to event network-changed-2341ac13-4d4d-40d6-9603-bd5277c46280. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:38:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5137e5ce-2093-4062-8e8e-1d817b08b90c req-2d39caac-1ac7-433a-bc28-a99bf6ac2dcb service nova] Acquiring lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:38:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5137e5ce-2093-4062-8e8e-1d817b08b90c req-2d39caac-1ac7-433a-bc28-a99bf6ac2dcb service nova] Acquired lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:38:31 user nova-compute[72426]: DEBUG nova.network.neutron [req-5137e5ce-2093-4062-8e8e-1d817b08b90c req-2d39caac-1ac7-433a-bc28-a99bf6ac2dcb service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Refreshing network info cache for port 2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:38:31 user nova-compute[72426]: DEBUG nova.network.neutron [req-5137e5ce-2093-4062-8e8e-1d817b08b90c req-2d39caac-1ac7-433a-bc28-a99bf6ac2dcb service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Updated VIF entry in instance network info cache for port 2341ac13-4d4d-40d6-9603-bd5277c46280. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:38:31 user nova-compute[72426]: DEBUG nova.network.neutron [req-5137e5ce-2093-4062-8e8e-1d817b08b90c req-2d39caac-1ac7-433a-bc28-a99bf6ac2dcb service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Updating instance_info_cache with network_info: [{"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:38:31 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-5137e5ce-2093-4062-8e8e-1d817b08b90c req-2d39caac-1ac7-433a-bc28-a99bf6ac2dcb service nova] Releasing lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690879112.6207871, ef6878eb-686c-4121-afb1-2b2dfbe2aa50 => Resumed> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:38:32 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] VM Resumed (Lifecycle Event)
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Instance event wait completed in 0 seconds for  {{(pid=72426) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Guest created on hypervisor {{(pid=72426) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 08:38:32 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Instance spawned successfully.
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:38:32 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.virt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Emitting event <LifecycleEvent: 1690879112.6232593, ef6878eb-686c-4121-afb1-2b2dfbe2aa50 => Started> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:38:32 user nova-compute[72426]: INFO nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] VM Started (Lifecycle Event)
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.compute.manager [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72426) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-afa3df36-44f9-4d9e-9bb9-3f9c965538e2 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.110s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-944b6df7-304f-48ec-8f71-74a972d7048a req-fcba4d38-8c02-4439-a179-63d501e6e7d6 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-944b6df7-304f-48ec-8f71-74a972d7048a req-fcba4d38-8c02-4439-a179-63d501e6e7d6 service nova] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-944b6df7-304f-48ec-8f71-74a972d7048a req-fcba4d38-8c02-4439-a179-63d501e6e7d6 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-944b6df7-304f-48ec-8f71-74a972d7048a req-fcba4d38-8c02-4439-a179-63d501e6e7d6 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-944b6df7-304f-48ec-8f71-74a972d7048a req-fcba4d38-8c02-4439-a179-63d501e6e7d6 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] No waiting events found dispatching network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:38:32 user nova-compute[72426]: WARNING nova.compute.manager [req-944b6df7-304f-48ec-8f71-74a972d7048a req-fcba4d38-8c02-4439-a179-63d501e6e7d6 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received unexpected event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade for instance with vm_state active and task_state None.
Aug 01 08:38:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG nova.objects.instance [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lazy-loading 'flavor' on Instance uuid 262464cd-ee17-433f-ac64-c6250c61af25 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:34 user nova-compute[72426]: INFO nova.compute.manager [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Attaching volume cf1778c5-0e42-4f8d-9649-1b4e03518124 to /dev/vdb
Aug 01 08:38:34 user nova-compute[72426]: DEBUG os_brick.utils [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7a439c-dab6-4753-beb1-c103b40fb3ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b128f8bf-155a-4fec-b82c-45f61809c20d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32e53dc-7fd4-421b-ab96-ae135ca439a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[256e53de-5cfc-498b-8810-d48af8dccbd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:38:34 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:38:34 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c28623e-3129-4118-96cb-781dcf8c1301]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG os_brick.utils [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:38:34 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Updating existing volume attachment record: 6529bd4d-118f-452b-8f76-437ddce55e73 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:38:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:40 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690879105.6620047, fb9c5fe4-05a8-4a04-92b9-eef36b32f777 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:38:40 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] VM Stopped (Lifecycle Event)
Aug 01 08:38:40 user nova-compute[72426]: DEBUG nova.compute.manager [None req-78126be6-4a5e-4ad7-bd91-93856e6d21dc None None] [instance: fb9c5fe4-05a8-4a04-92b9-eef36b32f777] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:38:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:38:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:38:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:38:43 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:38:43 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:38:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8261MB free_disk=25.341888427734375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 262464cd-ee17-433f-ac64-c6250c61af25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 21585d08-9e0b-4690-9273-c0bfb3cb40d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance ef6878eb-686c-4121-afb1-2b2dfbe2aa50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:38:43 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:38:44 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:38:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQxNKGTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:38:46 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:38:46 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:38:46 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c997da10-962c-4a43-afb9-742c440798b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:38:46 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eb5e26-93e2-44fb-b483-b5f78e8bddf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124] added
Aug 01 08:38:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6226f242-ef18-45e2-8b9f-b41c13c0a467]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a02f8a2-b103-47e0-bddd-aa9b8ca72853]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQxNKGTe {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQxNKGTe" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae91cab-b24a-4734-ab55-e46803f65741]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LQxNKGTe'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7982aac3-511a-49ec-8373-698df3e3794d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c547a94a-7f6d-484a-82e2-e3c4819dc449]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:38:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:38:46 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:38:46 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf53421-5393-4549-9877-c69ef7caa785]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124, portal: 172.16.0.220,3260]
Aug 01 08:38:47 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124, portal: 172.16.0.220,3260] successful.
Aug 01 08:38:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa935eeb-b340-4d01-9663-3b6b74d241b3]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27ba7dc-4d76-4f4b-8668-14dd0ec00fec]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:38:47 user nova-compute[72426]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 (non-flash)
Aug 01 08:38:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:38:47 user nova-compute[72426]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 (non-flash)
Aug 01 08:38:47 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a8803f-7c7e-4e5d-b876-7c3c4429c51a]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:38:47 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQxNKGTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:38:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:38:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23538626661346462', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:38:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538626661346462', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:38:48 user nova-compute[72426]: DEBUG nova.objects.instance [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lazy-loading 'flavor' on Instance uuid 262464cd-ee17-433f-ac64-c6250c61af25 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:38:48 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:38:48 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:38:48 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:38:48 user nova-compute[72426]:   <serial>cf1778c5-0e42-4f8d-9649-1b4e03518124</serial>
Aug 01 08:38:48 user nova-compute[72426]: </disk>
Aug 01 08:38:48 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:38:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:38:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:38:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] No VIF found with MAC fa:16:3e:0f:90:ce, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:38:48 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-599942d7-64a6-44a1-b53c-aa6c8b6d04ea tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.343s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:49 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:38:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:38:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:38:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:38:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:38:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Updating instance_info_cache with network_info: [{"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-262464cd-ee17-433f-ac64-c6250c61af25" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:38:50 user nova-compute[72426]: INFO nova.compute.manager [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Detaching volume cf1778c5-0e42-4f8d-9649-1b4e03518124
Aug 01 08:38:50 user nova-compute[72426]: INFO nova.virt.block_device [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Attempting to driver detach volume cf1778c5-0e42-4f8d-9649-1b4e03518124 from mountpoint /dev/vdb
Aug 01 08:38:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Attempting to detach device vdb from instance 262464cd-ee17-433f-ac64-c6250c61af25 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:38:50 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:38:50 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:38:50 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:38:50 user nova-compute[72426]:   <serial>cf1778c5-0e42-4f8d-9649-1b4e03518124</serial>
Aug 01 08:38:50 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:38:50 user nova-compute[72426]: </disk>
Aug 01 08:38:50 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:38:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Successfully detached device vdb from instance 262464cd-ee17-433f-ac64-c6250c61af25 from the persistent domain config.
Aug 01 08:38:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 262464cd-ee17-433f-ac64-c6250c61af25 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:38:50 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:38:50 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:38:50 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:38:50 user nova-compute[72426]:   <serial>cf1778c5-0e42-4f8d-9649-1b4e03518124</serial>
Aug 01 08:38:50 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:38:50 user nova-compute[72426]: </disk>
Aug 01 08:38:50 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690879130.8748426, 262464cd-ee17-433f-ac64-c6250c61af25 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 262464cd-ee17-433f-ac64-c6250c61af25 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:38:50 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Successfully detached device vdb from instance 262464cd-ee17-433f-ac64-c6250c61af25 from the live domain config.
Aug 01 08:38:50 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQxNKGTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:38:50 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:38:50 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ece18a9-77f8-4c81-aa9e-59ad01f59fd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c9f55-54fa-44b9-bc67-4f4d371a5c42]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:38:50 user nova-compute[72426]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 (non-flash)
Aug 01 08:38:50 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:38:50 user nova-compute[72426]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 (non-flash)
Aug 01 08:38:50 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38df7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[3845f2dd-2aa8-48e6-892c-1247a09dc045]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96b4db2-0a35-48b6-9851-b1812e4e26db]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:38:50 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9c1f3a-2a45-4b7a-8288-0f9b25eb815e]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a27ef0-e0e3-4bc0-978d-f533d7ee492d]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b902d23-d0f6-4d72-b9c9-a74459bd009d]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8d3023-600b-4f98-af33-8b386d38c6ee]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124, portal: 172.16.0.220,3260]
Aug 01 08:38:51 user nova-compute[72426]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124, portal: 172.16.0.220,3260] successful.
Aug 01 08:38:51 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf1778c5-0e42-4f8d-9649-1b4e03518124 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[350684b4-3ee7-4119-83c5-083c86d5731f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] <== disconnect_volume: return (266ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG nova.objects.instance [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lazy-loading 'flavor' on Instance uuid 262464cd-ee17-433f-ac64-c6250c61af25 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:38:51 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-f1a77e46-ffa4-468c-89d8-7a35117c2121 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.584s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:38:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:53 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:38:53 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:38:54 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:56 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:57 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:38:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:58 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:38:59 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:38:59 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:01 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:04 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:39:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:39:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-24c7c4d7-e910-40ec-b185-d696a1177514 req-6df42dbf-e473-4b8a-a554-e0e522b0f88a service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received event network-changed-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:39:32 user nova-compute[72426]: DEBUG nova.compute.manager [req-24c7c4d7-e910-40ec-b185-d696a1177514 req-6df42dbf-e473-4b8a-a554-e0e522b0f88a service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Refreshing instance network info cache due to event network-changed-1a76a6d5-7822-4841-b5c0-a9f2a34f7545. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:39:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-24c7c4d7-e910-40ec-b185-d696a1177514 req-6df42dbf-e473-4b8a-a554-e0e522b0f88a service nova] Acquiring lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:39:32 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-24c7c4d7-e910-40ec-b185-d696a1177514 req-6df42dbf-e473-4b8a-a554-e0e522b0f88a service nova] Acquired lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:39:32 user nova-compute[72426]: DEBUG nova.network.neutron [req-24c7c4d7-e910-40ec-b185-d696a1177514 req-6df42dbf-e473-4b8a-a554-e0e522b0f88a service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Refreshing network info cache for port 1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:39:33 user nova-compute[72426]: DEBUG nova.network.neutron [req-24c7c4d7-e910-40ec-b185-d696a1177514 req-6df42dbf-e473-4b8a-a554-e0e522b0f88a service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Updated VIF entry in instance network info cache for port 1a76a6d5-7822-4841-b5c0-a9f2a34f7545. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:39:33 user nova-compute[72426]: DEBUG nova.network.neutron [req-24c7c4d7-e910-40ec-b185-d696a1177514 req-6df42dbf-e473-4b8a-a554-e0e522b0f88a service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Updating instance_info_cache with network_info: [{"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:39:33 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-24c7c4d7-e910-40ec-b185-d696a1177514 req-6df42dbf-e473-4b8a-a554-e0e522b0f88a service nova] Releasing lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:39:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG nova.objects.instance [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'flavor' on Instance uuid 21585d08-9e0b-4690-9273-c0bfb3cb40d1 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:37 user nova-compute[72426]: INFO nova.compute.manager [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Attaching volume bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b to /dev/vdb
Aug 01 08:39:37 user nova-compute[72426]: DEBUG os_brick.utils [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aefc6f-0ed5-4065-942e-f6b1ee3fbcaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:614f1fd8be4a\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c13bea-2642-42e4-a670-0c76fe8e6d26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[675a4def-4a02-47bf-aa3f-ab360493ee2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc59eac-b30f-4a55-8835-b5a0078cfa36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Running cmd (subprocess): nvme version {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] nvme not present on system {{(pid=72426) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 08:39:37 user nova-compute[72426]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 08:39:37 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[050f300b-7e06-4324-99e2-6d96f99f9c1c]: (4, '') {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72426) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.lightos [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] LIGHTOS: no hostnqn found. {{(pid=72426) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG os_brick.utils [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:614f1fd8be4a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:39:37 user nova-compute[72426]: DEBUG nova.virt.block_device [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Updating existing volume attachment record: 5958067f-5739-4b56-b5d6-a33566ef6c94 {{(pid=72426) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 08:39:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:39:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:42 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk --force-share --output=json {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72426) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72426) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 08:39:43 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:39:43 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:39:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=25.33120346069336GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 262464cd-ee17-433f-ac64-c6250c61af25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance 21585d08-9e0b-4690-9273-c0bfb3cb40d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Instance ef6878eb-686c-4121-afb1-2b2dfbe2aa50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72426) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:39:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:39:44 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:39:44 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:39:44 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:39:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:44 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Calling os-brick to attach iSCSI Volume {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPAXOHMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:39:45 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:39:45 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:39:45 user nova-compute[72426]: INFO os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df0d055-1863-4f3c-ba4f-5e650def5b75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 08:39:45 user nova-compute[72426]:  {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --interface default --op new {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d5dc46-d955-4eef-ae33-5aa430eb835c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b] added\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b] added
Aug 01 08:39:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:45 user nova-compute[72426]: INFO nova.compute.manager [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Terminating instance
Aug 01 08:39:45 user nova-compute[72426]: DEBUG nova.compute.manager [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[41783113-5866-4059-8a4a-1319ddd299f1]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b304813-6495-49ff-994d-ba9fdbf812d9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPAXOHMU {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPAXOHMU" returned: 0 in 0.027s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c994adb1-1eeb-48ab-b26d-c1163d5e92fe]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BPAXOHMU'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2730da2-6b46-4643-98d0-7b4245aeb164]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dfbb55-9e57-4eb6-bf41-8624e50d318c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:39:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:39:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --login {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[a555ef3e-307b-4ca1-8a5c-89355025d7de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b, portal: 172.16.0.220,3260]
Aug 01 08:39:45 user nova-compute[72426]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b, portal: 172.16.0.220,3260] successful.
Aug 01 08:39:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[205ed93f-98a8-44c1-8591-52d086f63b18]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f97091-87b5-40e8-8689-1322e2287eb4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:39:45 user nova-compute[72426]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b (non-flash)
Aug 01 08:39:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:39:45 user nova-compute[72426]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b (non-flash)
Aug 01 08:39:45 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Connected to 172.16.0.220:3260 {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72426) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72426) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae10191-0528-478b-bdc5-758a405acd6d]: (4, ('- - 0', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72426) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPAXOHMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72426) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-cd9349bc-a0b4-4532-bb32-b7980cc96e67 req-acba0a59-45ba-493b-af5e-de1af86afe7f service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-vif-unplugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cd9349bc-a0b4-4532-bb32-b7980cc96e67 req-acba0a59-45ba-493b-af5e-de1af86afe7f service nova] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cd9349bc-a0b4-4532-bb32-b7980cc96e67 req-acba0a59-45ba-493b-af5e-de1af86afe7f service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-cd9349bc-a0b4-4532-bb32-b7980cc96e67 req-acba0a59-45ba-493b-af5e-de1af86afe7f service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-cd9349bc-a0b4-4532-bb32-b7980cc96e67 req-acba0a59-45ba-493b-af5e-de1af86afe7f service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] No waiting events found dispatching network-vif-unplugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG nova.compute.manager [req-cd9349bc-a0b4-4532-bb32-b7980cc96e67 req-acba0a59-45ba-493b-af5e-de1af86afe7f service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-vif-unplugged-2341ac13-4d4d-40d6-9603-bd5277c46280 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Instance destroyed successfully.
Aug 01 08:39:45 user nova-compute[72426]: DEBUG nova.objects.instance [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lazy-loading 'resources' on Instance uuid 262464cd-ee17-433f-ac64-c6250c61af25 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-201315796',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-201315796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2013157',id=49,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa/9a1G8HLWt4G3Cy8dhrQSlyxAHvMAYyYmeIkbe9H8CoJcxSnmVjXcwLGZfE7FLHLE7lTPCVoITdVeLP9em0p49Gk0O6Oiig+uIeCUn1FrSuajFCvYxPtg8KnTO9lDFw==',key_name='tempest-keypair-1734785821',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:36:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a34680570c864d7aa0ff5269d0d73434',ramdisk_id='',reservation_id='r-wao90jaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2119158265',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c36f2803e634f008de831a9c38cb1c3',uuid=262464cd-ee17-433f-ac64-c6250c61af25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Converting VIF {"id": "2341ac13-4d4d-40d6-9603-bd5277c46280", "address": "fa:16:3e:0f:90:ce", "network": {"id": "fbfc064a-eaec-43c8-98f7-90d696ab641e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885666211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a34680570c864d7aa0ff5269d0d73434", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2341ac13-4d", "ovs_interfaceid": "2341ac13-4d4d-40d6-9603-bd5277c46280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=2341ac13-4d4d-40d6-9603-bd5277c46280,network=Network(fbfc064a-eaec-43c8-98f7-90d696ab641e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2341ac13-4d') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG os_vif [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=2341ac13-4d4d-40d6-9603-bd5277c46280,network=Network(fbfc064a-eaec-43c8-98f7-90d696ab641e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2341ac13-4d') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2341ac13-4d, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:45 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:39:45 user nova-compute[72426]: INFO os_vif [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=2341ac13-4d4d-40d6-9603-bd5277c46280,network=Network(fbfc064a-eaec-43c8-98f7-90d696ab641e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2341ac13-4d')
Aug 01 08:39:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Deleting instance files /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25_del
Aug 01 08:39:45 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Deletion of /opt/stack/data/nova/instances/262464cd-ee17-433f-ac64-c6250c61af25_del complete
Aug 01 08:39:46 user nova-compute[72426]: INFO nova.compute.manager [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 08:39:46 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26530353662666336', 'path': '/dev/sdc'} {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530353662666336', 'path': '/dev/sdc'} {{(pid=72426) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG nova.objects.instance [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'flavor' on Instance uuid 21585d08-9e0b-4690-9273-c0bfb3cb40d1 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 08:39:46 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:39:46 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:39:46 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:39:46 user nova-compute[72426]:   <serial>bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b</serial>
Aug 01 08:39:46 user nova-compute[72426]: </disk>
Aug 01 08:39:46 user nova-compute[72426]:  {{(pid=72426) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72426) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 08:39:46 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] No VIF found with MAC fa:16:3e:52:cb:dd, not building metadata {{(pid=72426) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-a6b38859-c162-4521-a8af-b0d6016348b0 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.411s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:47 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Took 1.04 seconds to deallocate network for instance.
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-a2b317b6-0e01-4b4c-a16a-d6046b749bc8 req-e222ce09-854f-4476-a215-1deb5baf303f service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-vif-deleted-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:47 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Deleted allocations for instance 262464cd-ee17-433f-ac64-c6250c61af25
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd9f-c187-4f20-8eb7-655e43bdf8a1 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265 tempest-TestServerVolumeAttachScenarioOldVersion-2119158265-project-member] Lock "262464cd-ee17-433f-ac64-c6250c61af25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] No waiting events found dispatching network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:39:47 user nova-compute[72426]: WARNING nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received unexpected event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 for instance with vm_state deleted and task_state None.
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] No waiting events found dispatching network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:39:47 user nova-compute[72426]: WARNING nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received unexpected event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 for instance with vm_state deleted and task_state None.
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] No waiting events found dispatching network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:39:47 user nova-compute[72426]: WARNING nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received unexpected event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 for instance with vm_state deleted and task_state None.
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-vif-unplugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] No waiting events found dispatching network-vif-unplugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:39:47 user nova-compute[72426]: WARNING nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received unexpected event network-vif-unplugged-2341ac13-4d4d-40d6-9603-bd5277c46280 for instance with vm_state deleted and task_state None.
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Acquiring lock "262464cd-ee17-433f-ac64-c6250c61af25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] Lock "262464cd-ee17-433f-ac64-c6250c61af25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] No waiting events found dispatching network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:39:47 user nova-compute[72426]: WARNING nova.compute.manager [req-018946c5-9615-4a35-97d4-fd2832432fc2 req-d290f68c-861d-480e-84b0-71f9f63342e1 service nova] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Received unexpected event network-vif-plugged-2341ac13-4d4d-40d6-9603-bd5277c46280 for instance with vm_state deleted and task_state None.
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:39:47 user nova-compute[72426]: INFO nova.compute.manager [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Detaching volume bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b
Aug 01 08:39:47 user nova-compute[72426]: INFO nova.virt.block_device [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Attempting to driver detach volume bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b from mountpoint /dev/vdb
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Attempting to detach device vdb from instance 21585d08-9e0b-4690-9273-c0bfb3cb40d1 from the persistent domain config. {{(pid=72426) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:39:47 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:39:47 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:39:47 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:39:47 user nova-compute[72426]:   <serial>bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b</serial>
Aug 01 08:39:47 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:39:47 user nova-compute[72426]: </disk>
Aug 01 08:39:47 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:39:47 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully detached device vdb from instance 21585d08-9e0b-4690-9273-c0bfb3cb40d1 from the persistent domain config.
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21585d08-9e0b-4690-9273-c0bfb3cb40d1 from the live domain config. {{(pid=72426) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 08:39:47 user nova-compute[72426]: DEBUG nova.virt.libvirt.guest [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 08:39:47 user nova-compute[72426]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 08:39:47 user nova-compute[72426]:   <source dev="/dev/sdc"/>
Aug 01 08:39:47 user nova-compute[72426]:   <target dev="vdb" bus="virtio"/>
Aug 01 08:39:47 user nova-compute[72426]:   <serial>bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b</serial>
Aug 01 08:39:47 user nova-compute[72426]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 08:39:47 user nova-compute[72426]: </disk>
Aug 01 08:39:47 user nova-compute[72426]:  {{(pid=72426) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-39fe9fcd-1f24-4658-ad32-66aafab708b4 None None] Received event <DeviceRemovedEvent: 1690879188.26337, 21585d08-9e0b-4690-9273-c0bfb3cb40d1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72426) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.driver [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21585d08-9e0b-4690-9273-c0bfb3cb40d1 {{(pid=72426) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 08:39:48 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully detached device vdb from instance 21585d08-9e0b-4690-9273-c0bfb3cb40d1 from the live domain config.
Aug 01 08:39:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPAXOHMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:39:48 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[c857bd10-8ee3-46a6-8f7c-d2fb390b57d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c83404-dfc7-4bb0-b15e-14ea272ec5d5]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:39:48 user nova-compute[72426]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b (non-flash)
Aug 01 08:39:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:39:48 user nova-compute[72426]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b (non-flash)
Aug 01 08:39:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38cdef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b'): ({'sdc'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Removing single pathed devices sdc {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa78657c-7286-42de-a948-6bd94fe8ab83]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6479fbbd-998d-4639-a705-953464b6772a]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Flushing IO for device /dev/sdc {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f21d9d-d356-4588-9b68-57adf5792ed6]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] There are 0 instances to clean {{(pid=72426) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb530b4-3072-4911-8be1-668744b90d83]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] SCSI volumes sdc have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b073fb2-be08-4e21-8b79-41063f1a86a4]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63b0214-b59c-46b3-abef-8b735913d56d]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b, portal: 172.16.0.220,3260]
Aug 01 08:39:48 user nova-compute[72426]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b, portal: 172.16.0.220,3260] successful.
Aug 01 08:39:48 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd94455d-a73f-4b9c-a1ba-a9fa0a887a0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61d3586-7452-44bf-85d0-8d6a5fb429c0]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] <== disconnect_volume: return (284ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:39:48 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG nova.objects.instance [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'flavor' on Instance uuid 21585d08-9e0b-4690-9273-c0bfb3cb40d1 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-73abd0f5-e6cf-48c7-bf48-1cde6a43feb8 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.631s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquired lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Forcefully refreshing network info cache for instance {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG nova.network.neutron [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Updating instance_info_cache with network_info: [{"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Releasing lock "refresh_cache-21585d08-9e0b-4690-9273-c0bfb3cb40d1" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:39:49 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Updated the network info_cache for instance {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 08:39:50 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:52 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:39:53 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:53 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72426) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 08:39:54 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:39:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:39:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72426) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 08:39:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:39:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:39:55 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:39:57 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:58 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:39:59 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:40:00 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690879185.8622494, 262464cd-ee17-433f-ac64-c6250c61af25 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:40:00 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] VM Stopped (Lifecycle Event)
Aug 01 08:40:00 user nova-compute[72426]: DEBUG nova.compute.manager [None req-3a86aa76-cc58-4cd5-8283-bb867370ac27 None None] [instance: 262464cd-ee17-433f-ac64-c6250c61af25] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:40:00 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:40:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72426) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 08:40:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:40:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:40:05 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:07 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-731d1277-2b18-40b8-b138-d4b560784d7f req-633921fb-23cb-48fc-8fd2-4a768c92805a service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-changed-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG nova.compute.manager [req-731d1277-2b18-40b8-b138-d4b560784d7f req-633921fb-23cb-48fc-8fd2-4a768c92805a service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Refreshing instance network info cache due to event network-changed-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade. {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-731d1277-2b18-40b8-b138-d4b560784d7f req-633921fb-23cb-48fc-8fd2-4a768c92805a service nova] Acquiring lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-731d1277-2b18-40b8-b138-d4b560784d7f req-633921fb-23cb-48fc-8fd2-4a768c92805a service nova] Acquired lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG nova.network.neutron [req-731d1277-2b18-40b8-b138-d4b560784d7f req-633921fb-23cb-48fc-8fd2-4a768c92805a service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Refreshing network info cache for port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:08 user nova-compute[72426]: INFO nova.compute.manager [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Terminating instance
Aug 01 08:40:08 user nova-compute[72426]: DEBUG nova.compute.manager [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:40:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG nova.network.neutron [req-731d1277-2b18-40b8-b138-d4b560784d7f req-633921fb-23cb-48fc-8fd2-4a768c92805a service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updated VIF entry in instance network info cache for port c1a9ec2e-8c85-4851-b96b-6caae5eb4ade. {{(pid=72426) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG nova.network.neutron [req-731d1277-2b18-40b8-b138-d4b560784d7f req-633921fb-23cb-48fc-8fd2-4a768c92805a service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating instance_info_cache with network_info: [{"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-731d1277-2b18-40b8-b138-d4b560784d7f req-633921fb-23cb-48fc-8fd2-4a768c92805a service nova] Releasing lock "refresh_cache-ef6878eb-686c-4121-afb1-2b2dfbe2aa50" {{(pid=72426) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 08:40:09 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Instance destroyed successfully.
Aug 01 08:40:09 user nova-compute[72426]: DEBUG nova.objects.instance [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lazy-loading 'resources' on Instance uuid ef6878eb-686c-4121-afb1-2b2dfbe2aa50 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T08:34:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1516230263',display_name='tempest-TestShelveInstance-server-1516230263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1516230263',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsC56JDtGmrSrNNFqnCU+ElBlfxEp7MybjKUgi+K35GE/p1rJBrfqAQq4bZzrqcyOhsX/Ktd/e8fYCMjc1agpKUDPWyMadREtiKHCA+kqcnG2HFGBVapqbm/fOmJRu+Vg==',key_name='tempest-TestShelveInstance-1365898974',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a265b55817a4ee5abb5d363e09e53b5',ramdisk_id='',reservation_id='r-z7j7mj0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-787444776',owner_user_name='tempest-TestShelveInstance-787444776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:38:33Z,user_data=None,user_id='afa99527453b4d92a9737db9a6e7e51a',uuid=ef6878eb-686c-4121-afb1-2b2dfbe2aa50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converting VIF {"id": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "address": "fa:16:3e:46:9a:8e", "network": {"id": "6a857f8e-164e-43e8-8532-5a614d74ea73", "bridge": "br-int", "label": "tempest-TestShelveInstance-555974827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a265b55817a4ee5abb5d363e09e53b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a9ec2e-8c", "ovs_interfaceid": "c1a9ec2e-8c85-4851-b96b-6caae5eb4ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_vif [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1a9ec2e-8c, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:40:09 user nova-compute[72426]: INFO os_vif [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:9a:8e,bridge_name='br-int',has_traffic_filtering=True,id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade,network=Network(6a857f8e-164e-43e8-8532-5a614d74ea73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1a9ec2e-8c')
Aug 01 08:40:09 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] calling os-brick to detach iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8c5c3f21d0>, {'target_iqns': ['iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAgGVsZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 08:40:09 user nova-compute[72426]: WARNING os_brick.initiator.connectors.base [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b', 0)] {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[78992131-3e21-478c-ba0f-35ec1e92f768]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[69091b6e-3901-4cfb-b0be-753f01296685]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:40:09 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b (non-flash)
Aug 01 08:40:09 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c38c47d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b'): ({'sdb'}, set())}) {{(pid=72426) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Removing single pathed devices sdb {{(pid=72426) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d21315-955e-4bf5-bee1-7bf5f7a90a32]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e51ece2-259e-4b54-ae05-4c320474d592]: (4, ('ok\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Flushing IO for device /dev/sdb {{(pid=72426) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55ae826-7e02-439a-9e7b-4525621062f9]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72426) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[48848163-139a-4f51-b5d8-e025cfef84ec]: (4, ('1', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.linuxscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] SCSI volumes sdb have been removed. {{(pid=72426) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7d445405-3843968b9d4628cd', '/dev/disk/by-id/scsi-23338343339363862', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7d445405') {{(pid=83442) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b498c0-c392-4a3e-a9e1-5ed988ee8151]: (4, None) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b')] {{(pid=72426) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b86a94-f816-4e13-af0c-705ba91b7c5f]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --logout {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5dcafb-42e3-493a-910a-bf97b5f466d0]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260]
Aug 01 08:40:09 user nova-compute[72426]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b, portal: 172.16.0.220,3260] successful.
Aug 01 08:40:09 user nova-compute[72426]:  stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:40:09 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op delete {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dd5f10-29eb-428c-afc0-fa602ea1c54b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83442) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefe1c96-4463-499e-8c21-9c55e764a9ed]: (4, ('', '')) {{(pid=83442) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72426) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.base [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] <== disconnect_volume: return (304ms) None {{(pid=72426) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Disconnected iSCSI Volume {{(pid=72426) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 08:40:10 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Deleting instance files /opt/stack/data/nova/instances/ef6878eb-686c-4121-afb1-2b2dfbe2aa50_del
Aug 01 08:40:10 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Deletion of /opt/stack/data/nova/instances/ef6878eb-686c-4121-afb1-2b2dfbe2aa50_del complete
Aug 01 08:40:10 user nova-compute[72426]: INFO nova.compute.manager [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 01 08:40:10 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:40:10 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Took 0.55 seconds to deallocate network for instance.
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-3d9924cc-f119-4e42-940d-17860bfda2f7 req-f9b79bf1-8322-4b42-8303-e6a1b6fe42c2 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-vif-deleted-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:40:10 user nova-compute[72426]: INFO nova.compute.manager [req-3d9924cc-f119-4e42-940d-17860bfda2f7 req-f9b79bf1-8322-4b42-8303-e6a1b6fe42c2 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Neutron deleted interface c1a9ec2e-8c85-4851-b96b-6caae5eb4ade; detaching it from the instance and deleting it from the info cache
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.network.neutron [req-3d9924cc-f119-4e42-940d-17860bfda2f7 req-f9b79bf1-8322-4b42-8303-e6a1b6fe42c2 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-3d9924cc-f119-4e42-940d-17860bfda2f7 req-f9b79bf1-8322-4b42-8303-e6a1b6fe42c2 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Detach interface failed, port_id=c1a9ec2e-8c85-4851-b96b-6caae5eb4ade, reason: Instance ef6878eb-686c-4121-afb1-2b2dfbe2aa50 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-vif-unplugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] No waiting events found dispatching network-vif-unplugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-vif-unplugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] Acquiring lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:10 user nova-compute[72426]: DEBUG nova.compute.manager [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] No waiting events found dispatching network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:40:10 user nova-compute[72426]: WARNING nova.compute.manager [req-678fcc23-f535-4a12-a468-16df5e7200b7 req-203fb440-a758-43e9-8ae8-516b80e3b3e8 service nova] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Received unexpected event network-vif-plugged-c1a9ec2e-8c85-4851-b96b-6caae5eb4ade for instance with vm_state active and task_state deleting.
Aug 01 08:40:11 user nova-compute[72426]: INFO nova.compute.manager [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Took 0.78 seconds to detach 1 volumes for instance.
Aug 01 08:40:11 user nova-compute[72426]: DEBUG nova.compute.manager [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Deleting volume: 17dd5f10-29eb-428c-afc0-fa602ea1c54b {{(pid=72426) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 08:40:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:11 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:40:11 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:40:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:11 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Deleted allocations for instance ef6878eb-686c-4121-afb1-2b2dfbe2aa50
Aug 01 08:40:11 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-cb7503ce-38ea-4bec-90dc-2d8558aec8d5 tempest-TestShelveInstance-787444776 tempest-TestShelveInstance-787444776-project-member] Lock "ef6878eb-686c-4121-afb1-2b2dfbe2aa50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.004s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:14 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:19 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:24 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690879209.6553566, ef6878eb-686c-4121-afb1-2b2dfbe2aa50 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:40:24 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] VM Stopped (Lifecycle Event)
Aug 01 08:40:24 user nova-compute[72426]: DEBUG nova.compute.manager [None req-23020e24-32f3-44bb-bbc2-b4c539d37341 None None] [instance: ef6878eb-686c-4121-afb1-2b2dfbe2aa50] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:40:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:40:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72426) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 08:40:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:40:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:40:24 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:29 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:40:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72426) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 08:40:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:40:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72426) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 08:40:34 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:38 user nova-compute[72426]: INFO nova.compute.manager [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Terminating instance
Aug 01 08:40:38 user nova-compute[72426]: DEBUG nova.compute.manager [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Start destroying the instance on the hypervisor. {{(pid=72426) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-f449a4e5-127f-454c-a265-c74ec3b161bc req-7b7398ab-abf8-412f-948b-fb12aee34082 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received event network-vif-unplugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f449a4e5-127f-454c-a265-c74ec3b161bc req-7b7398ab-abf8-412f-948b-fb12aee34082 service nova] Acquiring lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f449a4e5-127f-454c-a265-c74ec3b161bc req-7b7398ab-abf8-412f-948b-fb12aee34082 service nova] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-f449a4e5-127f-454c-a265-c74ec3b161bc req-7b7398ab-abf8-412f-948b-fb12aee34082 service nova] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-f449a4e5-127f-454c-a265-c74ec3b161bc req-7b7398ab-abf8-412f-948b-fb12aee34082 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] No waiting events found dispatching network-vif-unplugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG nova.compute.manager [req-f449a4e5-127f-454c-a265-c74ec3b161bc req-7b7398ab-abf8-412f-948b-fb12aee34082 service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received event network-vif-unplugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 for instance with task_state deleting. {{(pid=72426) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 08:40:38 user nova-compute[72426]: INFO nova.virt.libvirt.driver [-] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Instance destroyed successfully.
Aug 01 08:40:38 user nova-compute[72426]: DEBUG nova.objects.instance [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lazy-loading 'resources' on Instance uuid 21585d08-9e0b-4690-9273-c0bfb3cb40d1 {{(pid=72426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG nova.virt.libvirt.vif [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T08:37:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1041718163',display_name='tempest-AttachVolumeNegativeTest-server-1041718163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1041718163',id=50,image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUuTGwzvSvlasnS2yPOLex2ESeVhJFw3K2vWKB9SFUW4F9siT1nQRStBvWI88H1zaqVEAmcgb94rAbAaS8+wl4VCNfr+zcdETCFZg2ae3oq2KO6PgcNN4ERby2PkVS70Q==',key_name='tempest-keypair-1625201307',keypairs=<?>,launch_index=0,launched_at=2023-08-01T08:37:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d0d23fc511343c698af4392fc3de94b',ramdisk_id='',reservation_id='r-jbttua7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d15c2a71-abe5-4334-bf77-67be8f572ede',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1212503363',owner_user_name='tempest-AttachVolumeNegativeTest-1212503363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T08:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53c85b986ed140c491cd0ed264e561c7',uuid=21585d08-9e0b-4690-9273-c0bfb3cb40d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converting VIF {"id": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "address": "fa:16:3e:52:cb:dd", "network": {"id": "913f414f-8bd2-4959-950e-5828ccd5b23c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1243842853-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d0d23fc511343c698af4392fc3de94b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a76a6d5-78", "ovs_interfaceid": "1a76a6d5-7822-4841-b5c0-a9f2a34f7545", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG nova.network.os_vif_util [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=1a76a6d5-7822-4841-b5c0-a9f2a34f7545,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a76a6d5-78') {{(pid=72426) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG os_vif [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=1a76a6d5-7822-4841-b5c0-a9f2a34f7545,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a76a6d5-78') {{(pid=72426) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a76a6d5-78, bridge=br-int, if_exists=True) {{(pid=72426) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:40:38 user nova-compute[72426]: INFO os_vif [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:cb:dd,bridge_name='br-int',has_traffic_filtering=True,id=1a76a6d5-7822-4841-b5c0-a9f2a34f7545,network=Network(913f414f-8bd2-4959-950e-5828ccd5b23c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a76a6d5-78')
Aug 01 08:40:38 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Deleting instance files /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1_del
Aug 01 08:40:38 user nova-compute[72426]: INFO nova.virt.libvirt.driver [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Deletion of /opt/stack/data/nova/instances/21585d08-9e0b-4690-9273-c0bfb3cb40d1_del complete
Aug 01 08:40:38 user nova-compute[72426]: INFO nova.compute.manager [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 08:40:38 user nova-compute[72426]: DEBUG oslo.service.loopingcall [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72426) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG nova.compute.manager [-] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Deallocating network for instance {{(pid=72426) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 08:40:38 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] deallocate_for_instance() {{(pid=72426) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 08:40:39 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.network.neutron [-] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:40:40 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Took 1.28 seconds to deallocate network for instance.
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-a6d1a53c-f103-42e4-b195-2191432a97b4 req-c52f089b-a2b2-4ab2-89ec-9c057ee1cccb service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received event network-vif-deleted-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:40:40 user nova-compute[72426]: INFO nova.compute.manager [req-a6d1a53c-f103-42e4-b195-2191432a97b4 req-c52f089b-a2b2-4ab2-89ec-9c057ee1cccb service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Neutron deleted interface 1a76a6d5-7822-4841-b5c0-a9f2a34f7545; detaching it from the instance and deleting it from the info cache
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.network.neutron [req-a6d1a53c-f103-42e4-b195-2191432a97b4 req-c52f089b-a2b2-4ab2-89ec-9c057ee1cccb service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Updating instance_info_cache with network_info: [] {{(pid=72426) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-a6d1a53c-f103-42e4-b195-2191432a97b4 req-c52f089b-a2b2-4ab2-89ec-9c057ee1cccb service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Detach interface failed, port_id=1a76a6d5-7822-4841-b5c0-a9f2a34f7545, reason: Instance 21585d08-9e0b-4690-9273-c0bfb3cb40d1 could not be found. {{(pid=72426) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Refreshing inventories for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Updating ProviderTree inventory for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Updating inventory in ProviderTree for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Refreshing aggregate associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, aggregates: None {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Refreshing trait associations for resource provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99, traits: COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=72426) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-4bc06ec7-ea10-4415-acfb-ed1014becbd0 req-a38bba85-2960-4dec-abaf-c36cb25a5b4c service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received event network-vif-plugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4bc06ec7-ea10-4415-acfb-ed1014becbd0 req-a38bba85-2960-4dec-abaf-c36cb25a5b4c service nova] Acquiring lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4bc06ec7-ea10-4415-acfb-ed1014becbd0 req-a38bba85-2960-4dec-abaf-c36cb25a5b4c service nova] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [req-4bc06ec7-ea10-4415-acfb-ed1014becbd0 req-a38bba85-2960-4dec-abaf-c36cb25a5b4c service nova] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.compute.manager [req-4bc06ec7-ea10-4415-acfb-ed1014becbd0 req-a38bba85-2960-4dec-abaf-c36cb25a5b4c service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] No waiting events found dispatching network-vif-plugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 {{(pid=72426) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 08:40:40 user nova-compute[72426]: WARNING nova.compute.manager [req-4bc06ec7-ea10-4415-acfb-ed1014becbd0 req-a38bba85-2960-4dec-abaf-c36cb25a5b4c service nova] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Received unexpected event network-vif-plugged-1a76a6d5-7822-4841-b5c0-a9f2a34f7545 for instance with vm_state deleted and task_state None.
Aug 01 08:40:40 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:40:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:40 user nova-compute[72426]: INFO nova.scheduler.client.report [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Deleted allocations for instance 21585d08-9e0b-4690-9273-c0bfb3cb40d1
Aug 01 08:40:40 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-1e0addf3-391e-48b0-87f7-800ab0d8b963 tempest-AttachVolumeNegativeTest-1212503363 tempest-AttachVolumeNegativeTest-1212503363-project-member] Lock "21585d08-9e0b-4690-9273-c0bfb3cb40d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.564s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:40:42 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:40:42 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:40:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=25.383785247802734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:40:42 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:40:43 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:40:43 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:40:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:47 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:40:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:40:50 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:40:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:40:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:40:50 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:40:53 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:40:53 user nova-compute[72426]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690879238.8135967, 21585d08-9e0b-4690-9273-c0bfb3cb40d1 => Stopped> {{(pid=72426) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 08:40:53 user nova-compute[72426]: INFO nova.compute.manager [-] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] VM Stopped (Lifecycle Event)
Aug 01 08:40:53 user nova-compute[72426]: DEBUG nova.compute.manager [None req-73e427db-33eb-48ed-97de-b2484d4d7d1e None None] [instance: 21585d08-9e0b-4690-9273-c0bfb3cb40d1] Checking state {{(pid=72426) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 08:40:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:40:54 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:40:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:40:56 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:40:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:40:59 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:40:59 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:41:00 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:41:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:06 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:41:44 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:41:44 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:41:44 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.374313354492188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:41:44 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:41:46 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:47 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:41:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:41:50 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:41:52 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:41:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:41:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:41:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:41:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:41:54 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:41:54 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:41:55 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:41:57 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:41:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:00 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:42:00 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:42:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:42:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:42:43 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Auditing locally available compute resources for user (node: user) {{(pid=72426) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 08:42:45 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:42:45 user nova-compute[72426]: WARNING nova.virt.libvirt.driver [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 08:42:45 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=25.37195587158203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72426) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72426) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG nova.compute.provider_tree [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed in ProviderTree for provider: 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 {{(pid=72426) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG nova.scheduler.client.report [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Inventory has not changed for provider 857b4ca4-2f0e-4cc5-bf9a-50b98073ab99 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72426) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG nova.compute.resource_tracker [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Compute_service record updated for user:user {{(pid=72426) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 08:42:45 user nova-compute[72426]: DEBUG oslo_concurrency.lockutils [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=72426) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 08:42:48 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:49 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:42:52 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:42:52 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:42:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Starting heal instance info cache {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 08:42:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Rebuilding the list of instances to heal {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 08:42:52 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Didn't find any instances for network info cache update. {{(pid=72426) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 08:42:53 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:55 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:42:55 user nova-compute[72426]: DEBUG nova.compute.manager [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72426) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 08:42:57 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:42:58 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:42:59 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:43:00 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:43:02 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:43:03 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 08:43:04 user nova-compute[72426]: DEBUG oslo_service.periodic_task [None req-30ea99a0-f1fb-414b-b3e7-97dfd2c4012f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72426) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 08:43:08 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:43:12 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:43:13 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:43:18 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:43:23 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:43:28 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:43:33 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 08:43:38 user nova-compute[72426]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72426) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}